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(54) INFORMATION PROCESSING APPARATUS AND METHOD, PROGRAM, AND RECORDED 
MEDIUM 


(5^ In case continuous reproduction is cx>mmanded 
from a first AV stream to a second AV stream, a third AV 
streani, made up of a preset portion of the first AV 
stream and a preset portion of the second AV stream, 
is generated. The third AV stream is reproduced when 
reproduction Is switched from the first AV.stream to the 
second AV stream. As the infomnation pertinent to the 


third AV stream, the address infonnation of a source 
packet of the first AV stream at a timing of switching from 
the first AV stream to the third AV stream and the ad-. 
. dress Infonnation of a source packet of the second AV 
stream at a timing of switching from the third AV stream 
to the second AV stream, are generated. This enat>les 
reproduction such as to maintain continuity between 
separately recorded AV streams. 
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Description 

Technical Field 

s [0001 1 This Invention relates to an Infomialton proceseing method and apparatus, a program, and a recording medium 
and, more particularly, to an Intormation processing method and apparatus, a program and a recording medium, oon- 
rigured for maintaining continuity of moving pictures In a reproducing domain. 

Background Art 

10 

[0002] Recently, a variety of types of optical discs have been proposed as a recording medium that can be removed 
from a recording apparatus. These recordable optical discs have been proposed as a large capacity medium of several 
GBs and are thought to be promising as a medium for recording AV (audio visual) signals, such as video signals. 
Among the digital AV signal sources (supply sources), to be recorded on this recordable optical disc, there are CS 
15 digital satellite broadcast and BS digital broadcast. Additionally, the ground wave television broadcast of the digital 
system has also been proposed for future use. 

[0003] The digital video signals, supplied from these sources, are routinely compressed under the MPEG (Moving 
Picture Experts Group) 2 system. In a recording apparatus,, a recording rate proper to the apparatus Is set If digital 
video signals of the digital broadcast are recorded In the conventional Image storage mediums for domestic use. digital 
20 video signals are first decoded and subsequently bandwidth-limited for recording. In the case of the digital recording 
system, Including, of course, the MPEG1 Video, MPEG2 video and The present Invention provides an DV systems, 
digital video signals are first decoded and subsequently re^encoded in accordance with an encoding eystern for the 
recording rate proper to the apparatus for recording subsequently. 

[0004] However, this recording system, In which the supplied bitstream is decoded once and subsequently band- 
25 width-llmited and re-encoded prior to recording, suffers from deteriorated picture quality. It, In recording compressed 
video digital signals, the transmission rate of input digital signals is less than the recording rate for the recording and/ 
or reproducing apparatus, the n^ethod of directly recording the supplied bitstream-wfthout decoding or re-encodIng 
suffers from deterioration in the picture quality only to the least extent. However, If the transmission rate of the Input 
digital signals exceeds the recording rate of the recording and/or reproducing apparatus. It is indeed necessary to re- 
30 encode the bitstream and to record the so-re-encoded bitstream, so that, after decoding in the recording and/or repro- 
ducing apparatus, the transmission rate will be not higher than the upper limit of the disc recording rate, 
[0005] If the bitstream Is transmined in a variable rate system in which the bit rate of the input digital signal is Increased 
or decreased with time, the capacity of the recording medium can be exploited less wastefully In the case of a disc 
recording apparatus adapted for transiently storing data In a buffer and for recording the data In a burst fashion than 
^ in the case of a tape recording system having a fixed recording rate imposed by the fixed rpm of the rotary head. 
[0006] Thus, it may be predicted that, in the near future when the digital broadcast is to become the mainstream, an 
increasing demand will be raised for a recording and/or reproducing apparatus in which broadcast sigrials are recorded 
as digital signals, without decoding or re-encodIng, as In a data streamer, and In which a disc is used as a recording 
medium. 

^ [0007] In reproducing data recorded on a recording medium In the above-described recording apparatus, there is 
known so-called skip reproduction in which reproduction is continued up to a preset picture and a picture. temporally 
spaced apart from the preset picture is reproduced next. This siclp reproduction has a drawbacic that temporal continuity 
Is lost in the reproduced pictures. 

^ Disclosure of the Invention 

[0008] It is therefore an object of the present invention to enable reproduction such as to maintain continuity of moving 
pictures In the playback domain, 

[0009], The present Invention provides an Infonnatlon processing apparatus Including generating means for gener- 
ic atlng, In case continuous reproduction from a first AV stream to a second AV stream Is commanded, a third AV stream 
made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV stream 
being reproduced when reproduction Is switched from the first AV stream to the second AV stream, and the address 
Infonnation. asthelhfomnation pertinent to the third AVstream, the address Infomriatlon being made up of the Information 
on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first AV stream 
55 to the third AV stream, and of the Information on the address of a source pad<et of the second AV stream at a timing 
of switching of reproduction from the third AV stream to the second AV stream, and recording means for recording the 
third AV stream and the address Infonnation, as generated by the generating means. 

[0010] Preferably, an arrival time stanp of the source packet of the first AV stream Included In the address Infonmatbn 
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generated by the generating means, and an arrival time stamp of a source packet located at a leading end of the third 
AV stream, are continuous to each other, and an artvai time stamp of the source paclcet of the second AV stream 
Included in the address, infomiation generated by the generating means and an anival time stamp of a source packet 
located at a trailing end of the third AV strearn are continuous to each other. 
5 [0011] Preferably, a sole discontinuous point exists In the anival time stamp of the source packet in the third AV 
stream. 

[0012] Preferably, the address is determined so that a data portion of the AV stream previous to a source packet 
specified by the infomiation on the address of the source packet of the first AV stream contained tn the address infor- 
mation generated by the generating means will be located In a-continuous area of not less than a preset size on a 
10 recording medium. 

[0013] Preferably, the address Is detemnined so that a data portion of the AV stream subsequent to a source packet 
specified by the Information on the address of the source packet of the second AV stream contained In the address 
information generated by the generating means will be located in a continuous area of not less than a preset size on 
a recording medium. 

15 [0Q1 4] Preferably, the third AV stream is generated so that the third AV stream will be located in a continuous area 
of not less than a preset 6lze on the recording medium. 

[001 5] The present Inventbn also provides an information generating method including a step of generating, in case 
continuous reproduction from a fir&t AV stream to a second AV stream is commanded, a third AV stream made up of 
a preset portton of the first AV stream and a preset portbn of the second AV stream, the third AV stream being repro- 

SO duced when reproduction is switched from the first AV stream to the second AV stream, and a step of generating the 
address information, as the. infomiation pertinent to the third AV stream, the address infonnatlon being made up of the 
information on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
/ first AV stream to the third AV stream, and of the Infonmatlon on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 

^ [0016] The present frivention also provides a recording medium having recorded thereon, a computer-readable pro- 
gram, In which the program includes a step of generating, in case continuous reproduction from a first AV stream to a 
second AV stream is comrhanded, a third AV stream made up of a preset portion of the first AV stream and a preset 
portion of the second AV stream, the third AV stream being reproduced when reproduction is switched from the first 
AV stream to the second AV strearn, and a step of generating the address information, as the Information pertinent to 

30 the third AV stream, the address Infonnation being made up of the information on an address of a source packet of 
the first AV stream at a timing of switching of reproduction from the first AV stream to the third AV stream, and of the 
infoonation on the address of a source packet of the second AV stream at a timing- of switching of reproduction from 
the third AV stream to the second AV stream. 

[001 7] The present invention also provides a program for having a computer execute a pmgram, In which the program 
35 includes a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream, the third AV stream being reproduced when reproduction is switched from the first AV stream to the-second 
AV stream, and a step of generating the address information, as the information pertinent to the third AV stream, the 
address information being made up of the information on an address, of a source packet of the first AV stream at a 
40 timing of switching of reproduction from the first AV stream to the third AV stream, and of the information on the address 
of a source packet of the second AV stream at a timing of switching of reproduction from the third AV stream to the 
second AV stream. 

[0018] The present invention also provides an infomiation processing apparatus including first readout means for 
. reading out a first AV stream, ia second AV stream or a third AV stream from a recording medium, second readout 

45 . means for reading out, as the Infonr^ation pertinent to the third AV stream, the information on an address of a source, 
packet of the first AV stream at a timing of switching of reproduction from the first AV streiEun to the third AV stream; 
and of the information on the address of a source packet of the second AV stream at a timing of switching of rep reduction 
from the third AV stream to the second AV stream, and reproducing means for performing reproduction as reproduction 
Is switched from the first AV stream read out by the first readout means to the third AV stream and from the third AV 

so stream to the second AV stream, based on the infomiation pertinent to the third AV stream read out by the second 
readout means. 

[0019] The present inventk>n also proyides an information processing method inciudinjg a first readout controlling 
step of reading out a first AV stream, a secortd AV stream or a third AV stream from a recording medium, a second 
readout controlling.step of reading out, as the information pertinent to the third AV stream, the infoimation on an address 
. 55- of a source packet of the first AV stream at a timing of switchffig of reproduction from the first AV strearn to the third 
AV stream, and of the information on the address of a source packet of the second AV stream at a timing of switching 
of reproduction from the third AV stream to the second AV stream, and a reproducing step of perfomning reproduction 
as reproduction is switched from the first AV stream read out by the first readout means to the third AV stream and 
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• from the third AV Gtream to the second AV stream, baeed on the Infomnatlon pertinent to the third AV stream read out 
by the second readout means. 

[0020] The present invention also provides a recording medium having recorded thereon a computer*readable pro- 
gram, In which the program includes a first readout controlling step of reading out a first AV stream, a second AV stream 

5 or a third AV stream from a recording medium, a second readout controlling step of reading out, as the Infomnatlon 
pertinent to the third AV stream, the Information on an address of a source packet of the first AV stream at a liming of 
switching of reproduction from the first AV stream to the third AV stream, and of the information on the address of a 
source paci<et of the second AV stream at a timing of switching of reproduction from the third AV stream to the second 
AV stream, and a reproducing step of perfomning reproduction as reproduction Is switched from the first AV stream 

10 read out by the first readout means to the third AV stream and from the third AV stream to the second AV stream, based 
on the infomnatlon pertinent to the third AV stream read out by the second readout means. 
[0021 ] The present invention also provides a program for haying a computer execute a program , In which the program 
Includes a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium, a second readout controlling step of reading out, as the Infomriatlon pertinent to the third AV 

15 stream, the Infonmation on an address of a source packet of the first AV stream at a timing of switching of reproduction 
from the first AV stream to. the third AV stream, and of the information on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, and.a reproducing 
step of perfomiing reproduction as reproduction Is switched from the first AV stream read out by the first readout means 
to the third AV stream and from the third AV stream to the second AV stream, based on the lnfomiatlon pertinent to 

^ the thirxJ AV stream read out by the second readout means. 

[0022] The present Invention also provides a recording medium having recorded thereon the address infonnatton 
Including, In case continuous reproduction from a first AV stream to a second AV stream Is commanded, a third AV 
stream made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV 
stream being reproduced when reproduction Is switched from the first AV stream to the second AV stream, and the 

^ address Infomiatlon, as the Informiation pertinent to the third AV stream, the address informatbn being made up of the 
infomnatlon on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
first AV stream to the third AV stream, and of the Infonnation on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 
p)023] In the Infomiatlon processing method and apparatus, and the program, according to the present Invention, If 

30 the It Is commanded to perfomn reproductton continuously from the first AV stream to the second AV stream, there ls- 
generated a third AV stream^ade up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and which is reproduced when reproduction is switched from the first AV stream to the second AV stream, while 
there is generate^, as the Information pertinent to the third AV stream, the address informatbn made up of the Infor- 
mation on an address of a source packet of the first AV stream at a tiniing of switching of reproduction from the first 

35 AV stream to the third AV stream, and of the Information on the address of a source packet of the second AV stream 
at a timing of switching of reproduction from the third AV stream to the second AV stream. 

[0024] in the information processing method and apparatus, and the program, according to the present invention, a 
first AV stream , a second AV stream or a third AV stream is read out from a recording medium, the address Infomnatlon 
made up of the infomnatlon on an address of a source packet of the first AV stream at a timing of switching of reproductbn 

^ from the first AV stream to the third AV stream, and the Infomnatlon on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, Is read out from 
the recording medium as the infomnatlon pertinent to the third AV stream, and reproduction Is switched from the first 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based oh the read^out Infomnatlon pertinent to the third AV stream. 

^ [0025] Other objects , features and advantages of the present invention will become more apparent from reading tiie 
embodiments of the present Invention as shown In the drawings. 

Brief Description of the Drawings 

so [0026] 

Fig. 1 shows a configuration of an embodiment of a recording and/or reproducing apparatus according to the present 
invention. 

Fig 2 Illustrates the data fomnat of data recorded on a recording medium by a recording and/or reproducing appa- 
55 ratus-L 

Fig.3 illustrates Real PlayLlst and Virtual Play List. 

Figs.4A, 4B and 4C Illustrate the creation of the Real PlayLlst. 

Flgs:SA, SB and 5C Illustrate deletion of the Real PlayLlst. 
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Figs.GA and 6B Illustrate assemble editing. 

Rg.7 illustrates provision of a sub path In the Virtual PlayLlst 

Fig.8 Illustrates the changing of the playback sequence of the PlayList. 

Flg.9 Illustrates a mark on the PlayList and a mark on the Clip. 

Flg.1 0 Illustrates a menu thumbnail 

Fig.11 Illustrates mark added to the PlayList. 

Flg.1 2 illustrates a mark added to the Clip. 

Flg.1 3 Illustrates the relation between the PlayList, Clip and the thumbnail file. 

Fig.i 4 illustrates a directory structure. 

Fig.1 5 Illustrates a syntax of infr.dvr. 

Fig.i 6 shows a syntax of DVRVolume. 

Fig.1 7 shows a syntax of ResumeVoiume. 

Fig.i 8 shows a syntax of U I Applnfo Volume. 

Rg. 1 9 shows a table of character set values. 

Fig.20 shows a syntax of TableOf PlayLlst. 

Flg.21 shows another syntax of TableOfPlayUst, 

Flg.22 shows a syntax of the MakersPhvateData. 

Flg.23 shows a syntax-of xxxx.rpis and yyyy. vpls. 

Flgs.24A to 24C illustrate the PlayLlst 

Flg.25 shows a syntax of PlayList 

Flg26 shows a table-of PlayUst^type. 

Fig.27 shows a syntax of UlApplnfoPlayList. 

Figs.28A to 28C illustrate flags In the UlApplnfoPlayList syntax shown In Fig.27. 
Flg.29 illustrates a Playitem. 
. Flg.30 Illustrates a! Playitem. 
Flg.31 illustrates a Playitem. 
Fig.32 shows a syntax of the Playitem. 
Fig.33 Illustrates IN-tlme. 
Rg.34 Illustrates OUT-tlme. 
Fig.35 shows a table of Connection.Condltion. 
Figs.36A to 36D illustrate Connectlon_Condltton.. 
Fig.37 illustrates BridgeSequencelnto. 
Fig.38 shows a syntax of BrIdgeSequencelnfo. 
Flg.39 Illustrates SubPlayitem. 
Fig.40 shows a syntax of SubPlayitem. 
Fi$.41 shows a table of Mark.type. 
Fig.42 shows a syntax of PlayListMark. 
Flg.43 shows a table of Mark_type. 
Flg.44 Illustrates MarKJInie_^8tamp. 
Fig.46 shows a syntax of zzzzz.cllp. 
Rg.46 shows a syntax of CHplnfo. 
Fig.47 shows a table.of Cllp_stream_type. 
Rg.48 illustrates offset^SPN. 

Rg.49 Illustrates o1fset_SPN. - 

Figs.50A, 5bB illustrate the STC domain. 

Flg.51 Illustrates STC^Info. 

Fig.52 shows a syntax of STC^Info. 

Fig.63 illustrates Programlnfo.. 

Fig.54 shows a syntax of Program Info. 

Fig.55 shows a syntax of VIdeoCondlnglnfo. 

Fig.56 shows e table of Video Jormat 

Fig.67 shows a table of f rame^rate . 

Flg.58 shows a table of dlsplay_aspect_ratlO: 

Fig.59 shows a syntax of AudloCondinglnfo. 

Fig.60 shows a table.of audio.codjng. 

Flg.61 shows a table of audlozComponent.type. 

Flg.62 shows a table of sampling .frequency. 

Fig.63 illustrates CPI. 
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Rg.64 illustrates CPI. 

Flg.65 shows a syntax of CPI. 

Flg.66 shows a table of CPLtype. 

Flg.67 illustrates video EP.map, 

Flg.68 illustrates EPl.map. 

Flg.69 illustrates EP_map. 

Ffg.70 shows a syntax of EP_map. 

Flg.71 shows a table of EP^typevalues, 

Flg.72 shows a syntax of EP_map_for_one_stream_PID. 

Flg,73 illustrates TU.map. 

Flg.74 shows a syntax of TU_map. 

Flg.76 shows a syntax of Clipli^ark. 

Fig76 shows a table of Mark.typa. 

Fig.77 shows a table of Mark.typo_stamp, 

Flg.78 shows a syntax of menu.thmb and maricthmb, 

Fig79 shows tha syntax of thumbnail. 

Ftg.BO shows a table of thunnbnall _picture_fonTtat. 

Figs.SIA and eiBillustrate tn^bloclc. 

Fig.82 Illustrates a stmcture of a transport.stream of DVR MPEG2. 

Flg.83 shows a recorder nnodel of a transport stream of DVR MPEG2. 

Fig.B4 shows a player model of a transport stream of DVR MPEG2. 

Flg.85 shows the syntax of a source packet. 

Flg,86 shows the syntax of TP^extra.header. 

Flg.87 shows a table of a copy pemilssion indicator. 

Flg.68 Illustrates seamless connection. 

Rg.8d illustrates seamless connection. 

Fig.90 illustrates seemfess connection. 

Flg.9l illustrates seamless connection. 

Fig. 92 Illustrates seamless connection. 

Fig.93 illustrates audio overlap. 

Fig.94 Illustrates seamless connection employing BrIdgeSequence. 

Flg.95 iilustretes seamless connection not employing BrIdgeSequence. 

Flg.96 shows a DVR STD model. 

Flg.97 Is a timing chart for decoding and dispfay. 

Flg.98 shows another syntax of BridgeSequenceinfo. 

Flg.99 Illustrates Bridge^CIlp when two Playltoms are seamlessly connected. 

Fig.lOO shows a syntax of a Clip Infonnatton file. 

Fig.1 Oi shows a syntax of a Cliplnfo of the Clip Infomiatlon file of Fig.1 00. 

Fig. 1 02 shows a syntax of a Seq uenceinf p of the Clip Inf omiiation file of Fig. 1 00. 

Figs,103A and 103B illustrate database change in case stream data of the Clip AV stream file is partially erased. 

Fig, 1 04 is a flowchart for illustrating the preparation of a ReafPlayLiet 

Fig. 1 05 is a flowchart for Illustrating the fomiulation of a Vlrtuat PlayLlst. 

Fig.1 06 Is a flowchart for illustrating the fomnulation of a bridge sequence. 

Fig.1 07 is a flowchart for illustrating the reproduction of PlayList . 

Fig.1 08 illustrates a medium. 

Best Mode for Canning out the invention 

C0027J Referring to the drawings, present embodiment of the present invention will be explained in detail. Rg.1 shows 
a typical Inner structure of a recording and/or reproducing apparatus 1 enFibodying the present invention. First, the 
structure of a recording unit 2, configured for recording signals input from outside, Is explained. The recording and/or 
reproducing apparatus 1 Is configured for being fed with and recording analog or digital data 
[0028] Analog video signals and analog audio signals are fed to temainals 11,12, respectively. The video signals^ 
input to the tenminai 11 , are output to an analysis unit 14 and to an AV encoder 15. The audio signals, Input to the 
tenminal 12, are output to the analysis.unit 14 and to the AV encoder 15. The analysis unit 14 extracts feature points, 
such as scene changes, from the Input^video and audio signals. 

[0029] The AV encoder 1 5 encodes input video and audio signal to output the system infonnatlon (S), such as an 
encoded video stream (V), an encoded audio stream (A) and AV synchronization, to a multiplexer 1 6. 
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[0030] The encoded video stream is a video stream encoded e.g., with the MPEG {IWoving Picture Expert Group) 2 
system, whilst the encoded audio stream is an audio stream encoded in acconiance with the MPEG1 system, with the . 
encoded audio stream being e.g., an audio stream encoded in e.g., the IVIPEG1 system or an audio stream encoded 
In accordance with the Dolby AC3 (trademak) system. The muttipiexer 1 6 multiplexes the input video and audio streams, 
based on the Input system Information, to output a multiplexed stream through a switch 17 to a multiplexed streanri 
analysis unit 18 andlo a source paclcetizer 191 

[0031] The multiplexed stream is e.g., an IS^PEG-2 transport stream or an MPEG2 program stream. The sourca 
packetizer 19 encodes the input multiplexed stream into an AV stream composed of source packets in accordance 
with an application fonnat of a recording medium 100 on whteh to record the stream. The AV stream is processed In 
€CC (error correctk>n and coding) unit 20 and a modulation unit 21 with appendage of ECC codes and with modulation, 
before being output to a write unit 22, which then writes (records) an AV stream file based on a control signals output, 
by the controller 23. = 

[0032] The transport stream, such as digital television broadcast, input from a digital interface or a digital television 
tuner, Is input to a tenminal 1 3. There are two recording systems for recording the transport stream input to the temfilnal 
13, one being a transparent recording system and the other being a system in which recording is preceded by re- 
encoding aimed to lower e.g., the recording bit rate. The recording system command information Is input from a temilnal 
24 as a user interface to a controller 23. 

[0033] In the transparent recording of the inpui transport stream, a transport stream, input to a temninal 1 3, is output 
through a switch 17 to a multiplexed stream,analysls unit 1 8 and to the source packetizer 1 9. The enisuing processing 
of recording an AV stream on a recording medium is the same as that of encoding and recording analog Input audio 
and video signals, as described above, and hence Is not explained here for simplicity. 

[0034] If the input transport stream Is re*encoded and subsequently recorded, the transport stream, Input to the 
tennlnal 13, is fed to a demultiplexer 26, which demultiplexes the iriput transport stream to extract a video stream (V), 
an audio stream (A) and the system information (S). 

[0035] Of the stream (tr^fomfiation), as extracted by the demultiplexer 26, the video stream is output to an audio 
decoder 27, whilst the audio stream and the system, information are output to the multiplexer 16. The audio decoder 
27 decodes the input transport stream to output the encoded video stream (V) to the multiplexer 1 6. 
[0036] The audio stream and the systehi information, output from the demultiplexer 26 and input to the multiplexer 
16, and the video stream, output by the AV encoder 15, are multiplexed, based on the input system information, and 
output to the multiplexed stream analysis unit 18 and to the source packetizer .19 through switch 17, as a multiplexed 
stream. The ensuing processing of recording an AV stream on a recording medium Is the same as that of encoding 
and recording analog Input audio and video signals, as described above^ and hence Is not explained here for simplicity. 
[0037] The recording and/or reproducing apparatus 1 of the present embodiment records a file of the AV stream on 
the recording medium ICQ, while aiso recording the application database infonmation which accounts for the file. The 
input information to the controller 23 is the feature infomnation for the moving ptoture from the analysis unit 14, the 
. feature inform'ation of the AV stream from the multiplexed stream analysis unit 1 8 and the user command information 
Input at a terminal 24. 

[0038] The feature infonnation of the moving pk^ture, supplied from die analysis unit 14, Is generated by the analysis 
unit 14 when the AV encoder 15 encQdi^s video signals. The analysis unit 14 analyzes the contents of the input video 
and audio signals to generate the infomnation pertinent to the pictures characteristic of the input moving picture signals 
(clip mark). This information is the Information indicating a picture of characteristic clip mark points, such as program 
start.polnts, scene change points, CM commercial start and end points, title or telop in input video signals, and also 
includes a thumbnail of the picture and the infomnation pertinent to stereo/monaural switching points and muted portions 
of audio signals. 

[0039] The atDOve picture indibating Infomiation is f ed through controller 23 to the multiplexer 16. When multiplexing 
a encoded picture specified as clip mark by the controller 23, the multiplexer 1 6 returns the information for specifying 
the encoded picture on the AV stream to the controller 23. Specifically, this information is the PTS (presentation time 
stamp) of a picture or the address information on the AV stream of an encoded version of the picture. The controller 
23 stores the sort of feature pictures and the information for specifying the encoded picture on the AV stream In asso- 
ciation with each other. 

[0040] The feature information of the AV streiam from the multiplexed stream analysis unit 18 is the information 
pertinent to the encoding information of the AV stream to be recorded, and is recorded by an analysis unit 18. For 
example, the feature infomiation includes the time stamp and address infomiation of the l-picture in the AV stream, 
discontinuous point information of system time clocks, encoding parameters, of the AV stream and change point Infor- 
mation of the encoding parameters in the AV stream. When transparently recording the transport stream, input from 
the tenninal 13, the multiplexed stream analysis unit 18 detects the picture of the aforementioned clip mark, from the 
input trarisport stream, and generates the information for specifying a picture designated by the clip mark and its type. 
[0041] The user designatksn infomiation from tiie tenninal 24 is the infonmation specifying the playback domain/ 
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designated by the user, character letters for explaining the contents of the playback domain, or the Information such 
as bookmarks or resuming points set by the user for his or her favorite scene. 

[0042] Based on the aforementioned Input Information, the controller 23 creates a database of the AV stream (Clip), 
a database of a group (PlayLlst) of playback domains (Playltem) of the AV stream, management Infomiation of the 
5 recorded contents of the recording medium 1CX) (Info.dvr) and the Infomiatlon on thumbnail pictures. Similarly to the 
AV stream, the appllcafron database Information, constructed from the above Information, Is processed In the ECC unit 
20 and the modulation unit 2 1 and Input to the write unit 22, which then records a database file on the recording medium 
100. 

[0043] The above-described application database infomiation will be explained subsequently In detail. 
10 [0044] When the AV stream file recorded on the recording medium 100 (files of picture data and speech data) and 
the application database infomnation, thus recorded on the recording medium 100, are reproduced by a reproducing 
unit 3. the controller 23 first commands a readout unit 28 to read out the application database Infomiatjon from the 
recording medium 1 00. The readout unit 28 reads out the application database infomiatlon from the recording medium 
100, which then reads out the application database information from the recording medium 1 00 to send the application 

19 database information through demodulation and enror conrection processing by a demodulating unit 2g and an. ECC 
decoder 30 to the controller 23. 

[0045] Based on the application database infomnatlon, the controller 23 outputs a list of PlayLlst recorded on the 
recording medium 1 00 to a user interfacie of the temiinal 24. The user selects the PlayLlst. desired to be reproduced, 
from the list of PlayLlsts. The infomiation pertinent to PlayLlst, specified to be reproduced, Is input to the controller 23. 

20 The controller 23 commands the readout unit 28 to read out the AV stream file necessary In reproducing the PlayLlst. 
In accordance with the command, the readout unit 28 reads out the con'esponding AV stream from the recording 
medium 100 to output the read-out AV stream to the demodulating unit 29, The AV stream, thus input to the demodu- 
lating unit 29, Is demodulated by preset processing and output through the processing by the ECC decoder 30 to a 
source depacketlzer 31 . 

25 [0046] The source depacketlzer 31 converts the AV stream of the application fomiat, read out from the recording 
medium 1 00 and processed in a preset fashion, into a stream processabie by the demultiplexer 26. The demultiplexer 
26 outputs the system information (S), such as the video stream (V), audio stream (A) or the AV synchronization, 
fomiing the playback domain (Playltem) of the AV stream specified by the controller 23, to the audio decoder 27, whteh 
AV decoder 27 decodes the video stream and the audio stream to output the playback video signal and the playback 

30 audio signal to associated temilnals 32, 33, respectively 

[0047] jf fed from the temninal 24, as a user Interface, with the Information instructing random access playback or 
special playback, the controller 23 determines the readout position of the AV stream from the riocordlng medium 100, 
based on the contents of the database (Clip) of the AV stream, to command the readout unit 28 to read oqt the AV 
stream. If the PlayLlst as selected by the user Is to be reproduced as from a preset time point, the controller 23 com- 

35 mands the readout unit 28 to read out data from an l-piclure having a time stamp ctosest to the specified time point 
[0048] When the user has selected a certain clip mark from Indexing points or scene change points for the program 
stored In the CllplVlark Ih the Clip Infomiation, as when the user selects a certain picture from a list of thumbnail pictures, . 
as demonstrated on a user interface, of the Indexing points or scene change points stored In the CiipMark, the controller 
23 detemnlnes the AV stream readout position from the recording medium 100 to command the readout unit 28 to read 

^ out the AV stream. That Is, the controller 23 commands the readout unit 28 to read out data from an l-picture having 
an address closest to the address on the AV stream which has stored the picture selected by the user. The readout 
unit 28 reads out data from the specified address . The read-out data is processed by the demodulating unit 29, ECC 
decoder 30 and by the source packetlzer 19 so as to be supplied to the demultiplexer 26 and decoded by the audio 
decoder 27 to reproduce AV data indicated by an address oif the mark point picture . 

45 [0049} If the user has commanded fast fonward playback, the controller 23 commands the readout unit 28 to sequen- 
tially read out l-picture data in-the AV stream in succession based on the database (Clip) of the AV stream. 
[0050] . The readout unit 28 reads out data of the AV stream from a specified random access point. The so read-out 
data is reproduced through processing by various components on the downstream side. 

[0051] The case In which the user edits the AV stream recorded on the recording medium 1 00 is now explained. If. 
so desired to specify a playback domain for the AV stream recorded on the recording medium 1 00, for example, if desired . 
to create a playback route of reproducing a portion sung by a singer A from a song program A, and subsequently 
reproducing a portion sung by the same singer A from another song program B, the information pertinent to a beginning 
point (IN-point) and an end point (OUT-poInt) of the playback domain Is Input to the controller 23 from the terminal as 
a user Interface. The controller 23 creates a database of the group (PlayUst) of playback domains (Playltem) of the 
• 55 AV streams. 

[0052] When the user desires to erase a portion of the AV stream recorded on the recording medium 1 00, the Infor- 
mation pertinent to the IN-point and the OUT-point of the erasure domain is input to the controller 23, which then 
• modifies the database of the PlayLlst so as to refer to only the needed AV streams. The controller 23 also commands 
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the write unit 22 to erase an unnTOded Stream portb^ 

[0053] The casein which the usfer desires to specify playback domains of an AV stream recorded on the recording 
medium to create a new playback route, andto Interconnect the respebtive playback domains in a seamless fashion, 
is now explained, In such cade, the controller 23 creates a database of a group (PlayLlst).of the. playback domains 
(Playltern) of the AV stream and undertakes to partially re-encode and re-multlplex the video strestfn In the vicinity of 
junction points of the piayback domains. 

[0054] The pfcture Infomialion at the IN-polnl and that at the OUt-point of a playback domain are Input from a lemiinal 
24 to a controller 23. The controller 23 commands the readout unit 28 to read out data needed to reproduce the pictures 
at the IN-point and at the OUT-point. The readout unit 28 reads out data from the recording, medium 100. The data so 
read out Is output. through the derpodulating unit 29,. ECC decoder 30 and the source packetizer 1 9 to the demultiplexer 

26; • ' . • ■-' 

[0055] The controller 23 analyzes data input to the demultiplexer 26 to determine the re-cncodlhg method for the 
video stream (change of picture_coding_type and assignment of the quantity of encoding bits for re-encodIng) and the 
re-multiplexing system to send the system to the AV encoder i 5 and to the nnultipjexer 1 6. 

. [0056] The demultplexer 26 then separates the input stream into the video stream (V), audio stream (A) and. the 
system Infonnation (S). The video stream may be classed into data input to the audio decoder 27 and data input to 
the multiplexer 16. The fonner Is data needed for re-encoding, and is decoded by the audto decoder 27, with the 
decoded picture being then re-encoded by the AV encoder 15 and thereby caused to become a video stream. The 
tatter data is data a>pled from an original stream without re-encodIng, The audio stream and the system information 
are directly input to the multiplexer 1 6. 

[0057] The multiplexer 1 6 multiplexes an Input stream, based on the Infomiation input from the controller 23, to output 
a multiplexed stream, which is processed by the ECC unit 20 and the modulation unit 21 so as to be sent to the write 
unit 22. The write unit 22 records an AV stream on the recording medium 100 based on the control signals supplied 
from the controller 23. 

[0058] the applicatioh database information and the operation based on this information, such as playback and 
edfting, are hereinafter explained. Fig.2 shows the structure of an application fohnat having two layers, that is PlayList 
ar>d Clip, for AV stream management. The Volume Ihfonnalion manages all Qips and PlayLlsts In the disc. Here, one 
AV stream and the ancillary Ipfomnation thereof, paired together, is deemed to be an object, and is termed Clip. The 
AV stream file is termed a Clip AV stream file, with the ancillary infonnatlon being termed the Clip Infomiation file. . 
[0059] One Clip AV stream flie stores data corresponding to an'MPEG-2 transport stream an-anged in a structure 
prescribed by the application format. By and large, a file Is treated as a byte string. The contents of the Clip AV stream 
file are expanded on the time axis, with entry points In the Clip (l-picture) being mainly specified on the time basis. 
When a time stamp of ari access point to a preset Clip Is giveri, the Clip Infomnatlon flle.ls useful In finding the address 
Infomriation at which to start data readout In the Clip AV stream file! 

[0060] Referring to Fig.3, PlayUst is now explained; which |s provided for a user to select a playback domain desired 
to be viewed from the Clip an^d to edit the playback domain readily. One PlayList Is a set of playback domairis In the 
Clip. One playback domain in a preset Clip is termed Playltern and is representied by a pair of an IN-point and an OUT- 
ppint on the time axis. So, the. PlayList is formed by a set of plural Piayltems, . 

[0061 ] . The PlayList is classif ied into two types, one of whteh is Re^i PlayUst and the other of which is Virtual PlayList. . 
The Real PlayList co-owns stream portions of the Clip it is referencing. That Is, the Real PlayList takes up in the disc 
the data capacity con^esponding to a stream portion of the Clip It is referencing and, when Real PlayList is erased, the 
data of tlie stream portion of the Clip it Is referencing is also erased. . 

[0062] The Virtual PlayList is not co-owning Clp data. Therefore, if the Virtual RayList is changed or erased, the 
contents of the Clip are in no way changed. 

[0063] The editing of the Real Playlist is explained. Fig.4A shows creation of Real PlayList and, if the AV stream is 
recorded as a new Clip, the Real PlayList which references the entire Clip is a newly created operation. 
[0064] Fig.4B shows the division of the real PlayList, that is the operation of dividing the Real PlayList at a desired 
point to split the Real PlayList in two Real PlayLlsts. This division operation is performed when two programs are 
managed in one clip managed by a sole PlayList arid when the user intends to re-register or re-record the programs 
as separate Indh/ldual progranr^. This operation does not- lead to_alteratron of the Clip contents, that is to division of 
the Clip Itself. 

[0065] Fig.4C shows the combining operation of the Real PlayList whfeh is the operation of confibining two Real 
PlayLlsts into one new Real PlayList. This. combining operatbn is perfomied sgch as when the user desires to re- 
register two programs as a sole program. This operatwn does not lead to alteration of the Clip, contents, that Is to 
combining the clip Itseff into one. 

[0066] Fig.SA-shows deletion of the entire Real PlayList If the operation of erasing the entire preset Real PlayUst, 

the associated stream portion of, the Clip referenced by the deleted Real PlayList is also deleted. 

[0067] Fig.SB shows, partial deletion of the Real PlayList. If a desired portion of the Real PlayList is deleted, the 
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associated Ptayltem is altered to reference onjy the needed Clip stream portion. The con-espondlng stream portion of 
the Clip Is deleted. 

[0068] Rg.5C shows the minimizing of the Real PiayUst. It is an operation of causing the Playitem associated with . 
the Real PlayUst to reference only the stream portion of the Clip needed for Virtual PiayLlst. The corresponding stream 

9 portion of the Clip not needed for the Virtual PlayUst Is deleted. 

[0069] If the Real PlayLisl Is changed by the above-described operation such that the stream portion of the Clip 
. referenced by the Real PiayLlst Is deleted, there ts a possibility that the Virtual PiayLlst employing the deleted Clip Is 
present such that problems may be produced in the Virtual PlayUst due to the deleted Clip. 
[0070] In order to prevent this from occurring, such a message which runs: "If there exists the Virtual Play List ref- 

10 erencing the stream portion of the Clip the Real PiayLlst is referencing, and the Real PiayLlst Is deleted, the Virtual 
PiayLlst Itself is deleted - is it all right?" is displayed for the user In response to the user's operation of deletion by way 
of conflmnation oralamiing, after which the processing for deletion Is executed or cancelled subject to user's commands. 
Alternatively, the minimizing operation for the Real PlayList is perfonned In place of deleting the Virtual PiayLlst. 
[0071] The operation for the Virtual PlayList is now explained. If an operation is performed for the Virtual PiayLlst, 

t5 the contents of the Clip are not changed. Figs.6A and 6B show the assembling and editing (IN-OUT editing). It is an 
. operation of creating Playitem of the playback domain the user has desired to view, to create Virtual PlayList. The 

seamless connection between Playltems is supported by the application format, as later explained. 

[0072]- If there exist two Real PlayLlsts 1 , 2 and clips 1 . 2 associated with the respective Real PtayLists, the user 

specifies a preset domain in the Reai PlayList 1 (domain from INI to 0UT1: Playitem 1) as the playback domain, and 
20 also specifies, as the domain to be reproduced next, a preset domain in the Reai PlayList 2 (domain from IN2 to 0UT2: 

Playitem 2) as the playback domain, as shown in Fig.6A, a sole Virtual PlayList made up of Playitem 1 and the Playltem2 

is prepared, as shown In Flg.6B. 

[0073] The re-editing of tiie Virtual PlayList Is now explained. The re-editing may be enumerated by alteration of IN- 
or OUT points in the Virtual PlayUst, Insertion or appendage of new Playltems to the Virtual PlayList and deletion of 

2s Playltems In the VIrtuial PlayLijSt. The Virtual PlayList itself may.also be deleted. 

[0074] Fig.7 ishows the audio dubbing (post recording) to the Virtual PiayLlst. It is an operation of registering the 
audio post recording to the Virtual PlayList as a sub path. This audio post recording Is supported by the appllcatbn 
software. An additional audio stream is added as a sub path to the AV stream of the main path of the Virtual PlayList. 
[0075] Common to the Real PlayList and the Virtual PlayList is an operation of changing (moving) the playback 

30 sequence of the PiayLlst shown in Flg.8. This operation Is an alteration of the playback^equence of the PlayList in.the 
disc (volume) and Is supported by TebleOf PiayUst as defined in the application format, as will be explained subse- 
quently with reference to e.g., Fig.20. This pperation does not lead to alteration. of the Clip contents. 
[0076] Tile nriark (Mark) is now explained. The mark Is provided for specifying a highlight or charactertstto time In the 
Clip and In the PlayList, as shown In Flg.9. The mark added to the Clip Is termed the CIlpMark. The CllplVlark is e.g., 
a program Indexing point or a scene change point for specifying a characteristic scene ascribable to contents In the 
AV stream. The ClipMark is generated by e.g., the analysis unit 14 of Fig.1 . When the PlayList is reproduced, the mark 
of the Clip referenced by the PlayList may be referenced and used. 

[0077] The mark appended to the PlayList is temied the PlayLlstMark (play list mark). The PlayListf^ark is e.g., a 
bookmark point or a resuming point as set by the user. The setting of the mark to the Clip and to the PlayList Is by 
^ adding a time stamp Indicating the mark time point to the mark list. On the other hand, mark deletion is removing tiie 
time stamp of the mark from the mark list. Consequently, the AV stream is In no way changed by mark setting or by 
mark deletion. 

[0078] As another fomnait of the Cllpiy^ark, a picture referenced by the ClipMark may be specified on the address 
basis In the AV stream. Mark setting on the Clip Is by adding the address .basis Information Indicating the picture of the 
^ mark point to the mark list. On the other hand, mark deletion is removing the address basis Information indicating the 
mark point picture from the mark list. Consequently, the AV stream ls.in no way changed by mark setting or by mark 
deletion. 

[0079] A thumbnail is now explained. The thumbnail Is a still picture added to the Volume, PlayList arid Clip. There 
are two sorts of the thumbnail, one of them being a thumbnail as a representative picture indicating the contents. This 
so Is mainly used In a mairi picture in order for the user to select what the or she desired to view on acting on a cursor, 
not shown. Another sort of the thumbnail Is a picture indicating a scene pointed by the mark. 
[0080] The Volume and the respective PlayLists need to own representative pictures. The representative pictures, 
of the Volume are presupposed to be used for inltlatly demonstrating a stlli picture representing the disc contents when 
the disc is set In position in the recording and/or reproducing apparatus 1 . it is noted that the disc means the recording 
medium 1 00 which is presupposed to be a of disc shape. The representative picture of the PlayList Is presupposed to 
be used as a still pteture for representing PlayList contents. 

[0081] As the representative picture of the PiayLlst, it may be contemplated to use the Initial pteture of the PiayLlst 
as the thumbnail (representative picture). However, the leading picture at the playback time of 0 is not necessarily an 
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optimum picture representing the contents. So, the user Is allowed to set an optional picture as a thurnbnail of the 
PlayList Two sorts of the thumbnails, that Is the thumbnail as a representative picture indicating the Volume and the 
thumbnail as a representative picture Indicating PlayList/are temned menu thumbnails. Since the menu thumbnails 
are demonstrated frequently, these thumbnails need to be read out at an elevated speed from the disc:. Thus, it Is 
5 efficient to store the totality of the menu thumbnails In a sole file. It Is unnecessary ifor the menu thumbnails to be 
pictures extracted from the moving pictures in the volume, but may be a picture' captured from a personal computer or 
. a digital still camera, as shown in Fig. 10. 

[0082] On the other hand, ttie Clip and the PlayList need be marked with plural marks, whilst the pictures of the mailt 
points need to be readily viewed In order to grasp the contents of the mark positions. The picture indicating such nnark 

^0 point is temied a mark thumbnail. Therefore, the pteture which is the original of the mark thumbnail is mainly an extracted 
• mark point picture ratherthan a pbture captured from outside. . 
[0083] Fig.11 shows the relation between the mark affixed to the PlayList and the mark thumbnail, whilst Fig. 12 
shows the relation between the mark affixed to the Clip and the mark thumbnail. In distinction from the menu thumbnail, 
the mark thumbnail Is tised in. e.g. , a sub-menu for representing details of the PlayList, while It is not requested to be 

. ^5 read out in a short access time. So, whenever a thumbnail is required, the recording and/or reproducing apparatus 1 
opens a file and reads out a portion of the file, while there is no problem presented even if file opening and readlrig 
out a portion of the file by the recording and/or reproducing iapparatus 1 takes some time. 

[0084] For decreasing the number of files present In a volume, it is prefen-ed for the totality of the mark thunriDnails 
to be stored-in one file. While the PlayList may ov/n one menu thumbnail and plural mark thumbnails, the user.is not 
20 required to select the Clip directly (usually, the Clip Is selected through PlayList), and hence there is no necessity of 
providing menu thumbnails. . • 

[0085] Fig.13 shows the rotation between the menu thumbnails, mark thumbnails, PlayList and Clips. In the menu* 
thumbnail iRIe are filed menu thumbnails provided from one PlayList to another, (n the rinenu thumbnail file is contained 
a volume thumbnail representing the contents of data recorded on the disc, in the menu thumbnail file are filed thunnb- 

25 nails created from one- PlayList to another and from one Clip to another. 

[0086] The GPl (Characteristic Point Infomnation) is heremafter explained. The CPI is data contained in the Clip 
information file and is used mairily for findirig a data address in the Clip AV stream file at whbh to start the data readout 
when a tinfte stamp of the access point to the Clip is afforded. In the present embodtmerit two sorts of the CP! are used, 
one of them being EP_map and the other being TU_map. 

30 [0087] The E P_map is a list of entry point (EP) data extracted from the elementary stream and the transport stream . 
This has the address I nfomriatibn used to find the site of entry points in the AV stream at which to start the decoding. 
One EP data is made up of a presentation time stamp (PTS) and a data address in the AV stream of the accessing 
unit associated with the PTSi with the data address being paired to the PTS. 

[0088] The EP_map Is used mainly for two purposes. First, It Is used for finding a data address in the AV stream in 
35 the accessing unit referenced by the PTS in . the PlayUsL Second, the EP_map is used for fast fonvard playback or 
fast reverse playback. If, In reOording the input AV stream by the recording and/or reproducing apparatus 1 , the syntax 
of the stream can be analyzed, the EP_map is created and recorded On the disc, 

[0089] The TU_map has a list of time unit (TU) data which is derived from the arrival time point of the transport packet 
input through a digital interface. This affords the relatiori between the arrival-tlme-based time and the date address in 
40 the AV stream. When the recording and/or reproducing apparatus 1 records an input AV stream, and the syntax of the 
stream cannot be analyzed, a TU^map is created and recorded on the disc. . ^ 

[0090] The STCInfo stores the discontinuous point infonnatlon in the A^ stream file which stores the MPEG-2 trans- 
port stream. ' . 

[0091] When the AV stream has discontinuous points of STC, the same PTS values may appear in the AV stream 
45 file. Thus, if a time point In the AV stream lis specified on the PTS basis, the PTS pf the access point Is insufficient to 
specify the point. Moreover, an index of the continuous STC domain containing the PTS is required. \x\ this fonnat, the 
continuous STC donriain and its index are temied an STC-sequence and STC-sequence-id/respectively. The STC- 
sequence Infonriation is defined by the STCInfo of the Clip Infomriation file. 

[0092] The STC-sequence-id is used in an AV stream file and Is optional in the AV strearn file having the TU_map; 
so [0093] The programs iare each a collection of elementary streanris and co-own a sole system time basefor synchro- 
nized reproduction of these streams. 

[0094] it Is useful for a reproducing apparatus (recording and/or reproducing apparatus 1 of Rg. 1) to know the 
contents of an AV stream prior to Its decoding. These contents Include e.g., values of the PID of a transport packet 
transmitting an audio or video elementary stream or the type of the video or audio components, such as HDTV video 
55 or MPEG-2 AAC audio stream. This Information Is useful for creating a menu screen foy illustrating to the user the 
contents of the PlayList referencing the AV stream. It is similarly useful for setting the initial state of the AV decoder 
and the demultiplexer of the respective apparatus. 
. [0095] For this reason, the Ciip Infomiation file owns Programlnfo for illustrating the program contents. 
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[0096] It may be an occurrence that program contents be changed In the AV stream file in which the M PEG-2 transport 
stream. Is stored.. For example, the PID of the transport packet transmitting the video elementary stream may be* 
changed, or the component type of the video stream may be changed from SDTV to HDTV. 
[0097] The Programlnfo stores the Information on change points of program contents in the AV stream file. The 
5 domain of the AV stream file In which the program contents remain constant Is tenned program-sequence. 

[009d] This program-sequence is used in an AV stream file having EP^map and Is opllonat In an AV stream file 
having TU__map. 

[0099] The present embodiment defines the self-encoding stream format (SESF). The SESF Is used for encoding 
analog input signals and for decoding digital input signals for subsequently encoding the decoded signal Into an MPEG- 
io 2 transport stream. 

[0100] The SESF defines an elementary stream pertinent to the MPEG-2 transport stream and the AV stream. When 
the recording and/or reproducing apparatus 1 encodes and records Input signals in the SESF, an EP.map is created 
and recorded on the disc. 

[0101] A digital broadcast stream uses one of the following systems for recording on the recording medium 100: 
IS First, the digital broadcast stream Is transcoded into an SESF stream, in this case, the recorded stream must confomn 
to SESF and EP.map must be prepared and recorded on the disc. 

[0102] Alternatively, an elementary stream forming a digital broadcast stream is transcoded to a new elementary 
stream and re-multipiexed to a new transport stream conforming to the stream fonnat prescribed by the organization 
for standardizing the digital broadcast stream. In this case, an EP_map must be created and recorded on the disc. 
20 [0103] For example, it is assumed that the input stream Is an MPEG-2 transport stream conforming to the iSDB 
(standard appellation of digital BS of Japan), with the transport stream containing the HDTV video stream and the 
MPEG AAC audio stream. The HDTV video stream is transcoded to an SDTV video stream, which SDTV video stream 
and the original AAC audio stream are re-multiplexed to TS. The SDTV stream and the transport stream both need to 
confonn to the ISDB fomiat. 

^ * [0104] Another system of recording the digital broadcast stream on the recording medum 1 DO Is to make transparent 
recording of the input transport stream, that is to record the Input transport stream unchanged, In which case the 
EP^map is fomiulated and recorded on the disc: 

[01 05] Alternatively, the Input transport stream is recorded transparently, that Is an input transport stream Is recorded 
unchanged, In which case TU^map is created and recorded on the disc. 

^ [01 06] The directory and the file are hereinafter explained. The recording and/or reproducing apparatus 1 is herein- 
after deschbed as DVR (digital video recording). FIg.l 4 shows a typical directory structure on the disc. The directories 
of the disc of the DVR may be enumerated by a root directory inciudrng "DVR" directory, and the "DVR" directory, 
Including -PLAYLIST' directory, "CLIPINF** directory, "M2TS" directory and "DATA* directory, as shown In Rg:l4. Al- 
though directories other than these nr^y be created below the root directory, these are discounted in the application 

35 format of the present embodiment. 

[01 07] Below the ^'DATA" directory, there are stored all files and directories prescribed by the DVR application f onnat. 
The "DVR" directory Includes four directories. Beiow the "PLAYLIst** directory are placed Real PlayUsi and Virtual 
PlayLlst database files. The latter directory may exist in a state devoid of PiayList. 

[0108] Beiow "CLiPINP Is placed e Clip database. This directory, too, may exist in a state devoid of AV stream files. 

40 In the "DATA" directory, there are stored flies of data broadcast, such as digital TV broadcast. 

[0109] The "DVR" directory stores the following files: That is, an "inf o.dvr" is created below the DVR directory to store 
the comprehensive Infomnation of an application layer Below the DVR directory, there must be a sole Ihfo.dvr The 
filename is assumed to be fixed to info.dvr. The "menu.thmb" stores the infomnation pertinent to the menu thumbnails. 
Below the DVR directory, there must be 0 or 1 mark thumbnails The filename Is assumed to be fixed to "menu.thmb". 

45 If there Is no menu thumbnail, this file may not exist. 

[0110] The "mark.thmb" file stores the Information pertinent to the mari< thumbnail picture. Below the DVR directory, 
there must be Dor 1 mark thumbnail. The filename Is assumed to be fbced to "menu.thmbMf there Is no menu thumbnail, 
. this file may not exist. 

[0111] The ^PLAYLIST* directory stores two sorts of.the PlayLlst files which are Real PlayLlst and Virtual PiayList. 
so An "xxxxx.rpfs" file stories the information pertinent to one Real PlayUst. One file Is created for each Real PlayLlst. The 
filename is "xxxxx.rp^s^ where "xxxxx" denotes five numerical figuries from 0 to 9. A file extender must be "rpls". 
[0112] The "yyyyy.vpis" stores the information pertinent to one Virtual PiayList. One file with a filename "yyyyy.vpis" 
is created from one Virtual PiayList to another, where "yyyyy" denotes ih/e numerical figures from 0 to 9 . A fJle extender 
must be "vpis". 

» [0113] The "CLIPINF" directory stores one file In assocliation with each AV stream file, The "zzzzz.cip!" is a Clip 
Infonnation file corresponding to one AV stream file (Clip AV stream file or Bridge-Clip stream file). The filename Is, 
"zzzz2.clpi", where "zzz^z" denotes five numerical figures from 0 to 9. A file extender must be "dpi". 
[01 14] The "M2TS" directory stores an AV stream file. The "zzzzz.m2ts" file Is an AV stream file handled by the DVR 
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system. This is a Clip AV stream file or a Bridge-Clip AV stream file. The filenarrie is "zzzzz.mSts", where ^'zzzzz" 
denotes fh/e numerical figures from 6 to 9. A file extender must be "m2ts". 

[0115] The "DATA" directory stores data transmitted .from data broadcasting. This data rnay, for exaniple, be XML 
or IVIPEG files. 

5 [0116] The syntax and the semantics of each directory (file) are now explained. Fig. 15 shows the syntax of the "ipfo. 
dvr^file. The "Info.dvr" tile is made up of three objects, that is DVRVoumeQ, TableOfPlayLtstsO and MalcersPrivateData 

'().'•"••. ' • ■ ■ • ■ . 

[0117] The syntax of info.dvr shown in Flg.15 is explained. TheTabieOfPIayLists^Start^address Indicates the leading 
address of the TableOfPiayLists() in tenns of the relative number of.bytes from the.leading byte of the "ihfo.dvr" file. 
^0 The relative humberofbytes Is counted beginning from 0. 

[0118] The MalcersPrivateData_Start_address indicates the leading address of the MakersPrivateData(), in terms 
of the relative number of bytes asf from the leading byte of the "info.dvr" file. The relative number of bytes is counted 
from 0. The padding^word is inserted in. asiBOciatidn with the syntax of **lnfo.dvr'. N1 and N2 are optional positive 
integers. Each padding word may assume an optional value. 

[0119] . The DVRVblumeO stores the infonmation stating the contents of the volume (disc). Flg,1 6 shows the^yntax 
of the DVRVolunie. The syntax of the DVRVolumeQ, shown in Fig.1 6, Is now e)q3lained. The version_number indicates, 
four character letters indicting the version nunUjers of the bVRVolurne(). The vereion^number is encoded to "0045' in 
association with IS0646. 

B)120J • Length is denoted by 32-bit unsigned integers Indicating the number of bytes from directly after the length 
. -ao f ield to the trailing end of DVRVolume(). 

[01 21 ] The ResumeVolume() memorizes the filename of th e Real PlayList or the Virtual PlayList reproduced last in 
the Volume. However, the plaj^ack position when the user has interrupted pla^^ Real PlayList or the Virtual 

PlayList is stored in the resume-mark defined in the PiayListMark() (see Figs,42 and 43). 

[0122] Fig,17 shows the syntax of the ResumeVolume(). The syntax of the ResumeVolume() shown in Fig.17 is 
25 explained. The valid Jlag indicates that the resume_PlayList_name field is valid or invalid when this 1-43it flag Is setto 
1 or 0, respectively 

[0123] The 1 0-byte field of resume_Play_List_name indicates the filename of the Real PlayList or the Virtual PlayList 
to be resumed. 

[0124] The UlApplnfoVolume in the syntax of the OVRVolumeQ, shown in Fig.16, stores parameters of the user 
so interface application conceming the Volume, Fig. 1 8 shows the syntax of the UlAppinfoVolumep the semantics of which 
are now explained. The 8-bit field of character_set indicates the encoding method for character letters encoded in the 
Volumejame field. The encoding method corresponds to the values shown In Fig.1 9. 
[0125] The 8-btt field of thenahriejength indicates the byte length of the Vol^^ 

field. The Vol ume_name field Indicates the appellation of the Volume. The number of bytes of the number of the= 
S5 namejength counted from left of the field is the number of valid characters and indicates the volume appellation. The 
vatuesnextfollowihgthese valid character letters may be any values. /. 

[01 26] The Volume^protectjag is a flag Indicating whether or not the contents in the Volume can be shown to the 
user without limitations. If this flag is set to 1 , the contents of the Volume are allowed to be presented (reproduced) to 
the user only in case the user has succeeded in correctly Inputting. the PIN number (password). If this flag is set to 0, 
^ the contents of the Volume are allowed to be presented to the user even In case the PIN number is not input by the user 
[0127] If, when the user has inserted a disc into a player, this fiag has been set to 0, or the flag is set to 1 but the 
user has succeeded In correctly inputting the PIN number, the recording and/or reproducing apparatus 1 demonstrates 
a list of the PlayList lathe disc. The .limitations on reproduction of the respective PlayLists are irrelevant to the 
Volume_protect Jlag and are Indicated by playbaclc_controLflag defined in the UlApplnfoVolume. 
[0128] The PIN is made lip of four numerical figures of from 0 to g. each of which is coded in accordance with ISO/ 
lEC 646. The ref.thumbnailjndex field indcates the information of a thumbnail picture added to the Volume. If the 
• ref_thumbnailjndex field Is of a value other than OxFFFF, a thumbnail picture is added to the Volume. The thumbnail 
picture is stored in a menu.thunrib file. The picture is referenced using the value of the ref Jhumbnailjndex in the menu! 
thumb file. If the ref_thumbnail_indexfleld is OxFFFF, it indicates that a thumbnail picture has been added to the Volume. 
so [0129] The TabieOfPlayList() in the info.dyr syntax shown in Flg.15 is explained. The.TableOfPlayLlst() stores the 
filename of the PlayList (Real PlayList and Virtual PlayList), All PlayList files recorded In the Volume are contained in 
the TableOfPlayLlstp, which TableOfPlayList() indicates the playback sequence of the default of the PlayList in the 
Volume. 

[0130] Fig.20 shows the syntax of the TableOfPlayListQ, which.is now explained. The version_number of the Table- 
ts OfPlayListO indicates four character letters indicating the version numbers of the TableOfPlayLists. The 
versfon_number must be encoded to "0045? in accordance with (SO 646. 

[0131 J Length Is a unsigned 32-bit integer indicating the number of bytes of the tabieOfPlayListQ from directly after 
the length field to the trailing end of the TabieOfPiayListQ. The 16-bit field of the number_of_PlayLists indicates the 
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number of loops of the for-loop Inclusive of the PlayLlst.f ile_name. This numerical figure must be equal to the number 
of PlayLlsts recorded In the Volume. The 10-byte numerical figure of the PiayListJIle jame indicates the filename of 
the PlayLlsts. 

[0132] Fjg.21 shows another configuration ofthe syntax of the TableOfPiayLlstQ. The syntax shown in Flg.21 Is com- 
5 prised of the syntax shown in Flg.20 In which Is contained the UlApplnfoPlayLlst. By such structure. Including the 
UlApplnfoPlayList, it becomes possible to create a menu picture simply on reading out the TableOfPlayLists. The 
following explanation is premised on the use of the syntax shown in Fig.20. 

[0133] The Mal<ersPrlvateData In tlie Info.dvr shown In Fig. 15 is explained. The MakersPrivateData is provided to 
permit the maimer of the recording and/or reproducing apparatus 1 to insert private data of the maker in the MakersPrl- 

10 vateDataO for special applications of different companies. The private data of each maker has standardized maker^lD 
for identifying the maker who has dofinod It, Tho MakorsPrivateDataQ may contain one or more maker.lD. 
[0134] if a preset maker intends to insert private data, and the private data of a different maker is already contained 
In the MakersPrivateDataO, the new private data is added to the MakersPrivateDataQ without erasing the pre-existing 
old private data. Thus, in the present embodiment, private data of plural makers can be contained In one MakersPri- 

15 vateData(). 

[0135] Fig.22 shows the synta)^ of the MakersPrivateData. The syntax of the IWakerePrlvateData shown in F!g.22 Is 
explained. The version^number ofthe TableOf PlayLlstQ Indicates four character letters Indicating the versbn numbers 
of the TableOfPlayLists. The version«number must be encoded to "0045" in accordance with ISO 646. 1.ength Is a 
unsigned 3Z-bit Integer indicating the number of bytes of the Tab leOiPiayListO from directly after the length field to the 

20 trailing end of the MakersPrivateDataQ, 

[0136] The mpd_blocks_start_addrBss Indicates the leading end address of the first mpd_block{) in terms of the 
relative number of bytes from the leading byte of the MakersPrivateData(). The number„of_maker_entrles is the 1 6-bit 
codeiess integer affording the number of entries of the maker private data included in the IVIakersPrivateData(). There 
must not be present two or more maker private data having the same maker^lD values in the MakersPrivateDataO. 

^ (0137] The mpd_blocks_size is a 1 6-blt unsigned Integer affording one mpd^block size in tenms of 1 024 bytes as a 
unit, For example, If nrpd_blocK_size = 1, It indfcates that the size of one mpd^block Is 1024 bytes. The 
number_of_mpd_biock8 Is a 1 6-blt unsigned integer affording the number of mpd.blocks contained In the MakersPrl- 
vateDataO- ThemakerJD is the 16-blt unsigned integer indicating the model numbercode of the DVR system- which 
has created the maker private data. The value encoded to the maker.lD Is specified by the licensor. 

30 [0138] The maker^modeLcode is a 16-bit unsigned Integer indicating the model number code of the DVR system 
which has created the maker private data. The value encoded to the maker_modei_code is set by the maker who has 
received the license of the format. The start_mpd_block_number is a 1 6-bit unsigned integer Indteating the number of 
the mpd.biock number at which begins the maker private data. The leading end of the maker private data must be 
aligned with the leading end of the mpd_block. The 8tart_mpd_block_number corresponds to a variable J in the for- 

33 loop of the mpd_block. 

[0139] The mpdjength is a 32-bit unsigned integer indbating the size of the maker private data. The mpd.biock is 
an area in which is stored maker private data. All of the mpd^blocks In tiie MakersPrivateDataQ must be of the same 
size. 

[0140] The real PiayUst file and the Virtual PlayList file, In other words, xxxxx.rpis and yyyyy.vpis, are explained. 
^ Fig,23 shows the syntax of xxxxx.rpis (Real PlayList) and yyyyy.vpis (Virtual PlayList), which are of the same syntax 
structure. Each of the xxxxx.rpis and yyyyy.vpis is made up of three objects, that is PlayLlstO, PlayLlstMark() and 
MakersPrivateDataQ, 

[0141] The PlayLlstMark^Start^address indicates the leading address of the PlayLlstMarkO, in tenms of the relative 
nurhber of bytes from the leading end of the PlayList file as a unit. The relativa number of bytes Is counted from zero. 
^ [0142] The MakerBPrivateData_Start_address Indicates the leading address of the MakersPrivateDataO, in terms 
of the relative number of bytes from the leading end of the PlayList file as a unit The relative number of bytes is counted 
from zero. ' 

[0143] The padding^word (padding word) is Inserted In accordance with the syntax of the PlayList file, with N1 and 
N2 being optional positive integers. Each padding word may assume an optional value. 
. ^ [0144] PlayUst will be further explained in the following although It has been explained briefly. A playback domain 
in ail Clips except Bridge-Clip must be referred by ail PlayLlsts in the disc. Also, two or more Real. PlayLlsts must not 
overlap the playback domains shown by their Piayltems In the same Cilp, 

[0145] Reference is made to Fig8.24A, 24B and 24C. For all Clips, there exist corresponding Real PlayLlsts. as 
shown In Flg.24A. This rule is observed even after the editing operation has come to a close, as shown in Fig.24B. 
ss Therefore, all Clips must be viewed by referencing one pf-Real PlayLlsts. 

[0146] Referring to Flg.24G, the playback domaln.of the Virtual PlayList rnust be contained In the playback domain 
and In the Bridge-Clip playback domain. There must not be present In the disc Bridge-Clip not referenced by any Virtual 
l^'layLlst 
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[0147] The Real PlayList, containing the list of the Piayltenn, must not contain SubPiayltem. The Virtual PlayList 
contains the Playltem list and, If the CPLtype contained in the PiayUstQ ts the EP.map type and the PlayList.type is 
0 (PlayList containing video and audio) , the Virtual PlayiJst may contain one SubPlayitem. In the PlayList() in tiSe 
present embodiment, the SubPiayltem Is used only for audio post recording. The number of the SubPiayttems owned 

s by one Virtual PlayList must be 0 or 1 . 

[0148] The PlayList is hereinafter explained. Fig.25 shows the PlayList syntax which is now explained. The 
verslon.number indicates four character letters indicting the version numbers of. the PlayLislQ. The version^number 
is encoded to "0045" In association with ISO 646. Length Is a 32-blt unsigned integer indicating the total number of 
byte of the PlayListQ from directly after the length field to the trailing end of the PiayUstQ. The PtayUst_type, one 

10 example of which Is shown in Rg.26, is an 8-bit field indicating the PlayList type. 

[0149] The CPl.type Is one-^bit flag indicating the value of the CPIJype of the Clip referenced by the PlayttemO and 
by the SubPlayltemQ. The CPLtypes defined in the CPIs of all Clips referenced by one PlayList must be of the sarne. 
values. The number_of„Play!tems Is a 16-bit field indicating the number of Play Items present in the PlayList 
[0150] The Playttemjd corresponding to the preset PlayltemO is defined by the sequence in which the PlayltemQ 
appears in the for-loop containing the PlayltemQ. The Playitemjd begins with 0. The nimber_of„SubPlayltems is a 
16-blt field indicating the nurhber of SubPiayltem in the PlayList. This value is 0 or 1. An additional audio stream path 
(audio stream path) is a sort of a sub path. 

[0151] The UlApplnfoPlayUst of the PlayList syntax shown in Fig.25 is-exptained. The UlAppinfoPlayList stores 
parameters of the user interface application concerning the PlayUst. Fig^T shows the syntax-of the UlApplnfoPiayList, 

^ which Is now explained. The character^set is an 8-bit field indicating the method for encoding character letters encoded 
in the PlayList.name field. The encoding method con-esponds to the values confonning to the table shown in Rg.19. 
' [01 52] The name Jength is ah 8-bit field indicating the byte length of the PlayList name indicated in the PlayList.name 
field. The PlayList_name field shows the appellation of the PlayList. The number of bytes of the number of the 
name Jength counted from left of the field is the number of valid characters and indicates thePlayLlst appellation . The 

2$ values next following these valid character letters may be any values. 

[0153] The record_time_and_date is a56-bit field storing the date and time on which the PlayList was recorded. This 
field is 14 numerical figures for year/ month/ day/ hour/minute/ second encoded in binary coded decimal (BCD). For 
example, 2001/12/ 23:01 :02:03 is encoded to "0x20011223010203". 

[0154] The duration Is a 24-bit field indicating the total replay time of the PlayList in temris of hour/ minute/ second 
30 as a unit. This field is six numerical figures encoded in binary coded decimal (BCD). For example, 01 :45:30 is encoded 
to "0x014630". 

[0155] The validj^eriod is a 32-bit field indicating the valid time periods of the PlayList. This field is 6 numerical 
figures encoded In 4-blt binary coded decimal (BCD). The valid joeriod is used in the recording and/or-reproducing 
apparatus 1 e.g., when the PlayList, for which the valid period hais lapsied, Is to be automatically erased. For example, 

35 2001/05/07 Is encoded to "0x20010507". 

[0156] The maker_ID is a 18-bit unsigned integer Indicating the maker of the DVR player (recording and/or repro- 
ducing apparatus 1 ) which has been the last to update its PlayList. The value encoded to makerJD is assigned to the 
licensor of the DVR fomiat The maker.code is a 16-bit unsigned integer indicating the model number of the DVR 
player which has been the last to update the PlayList. The value encoded to the maker_code is detenmined by the 

^ ' maker who has recehred the license of the DVR format. 

[0157] if the flag of the playback.controLflag is set to 1 , its PlayList Is reproduced only when the user successfully 
entered the PIN number. If this flag is set to 0, the user may view the PlayList without the necessity of inputting the 
PIN number. 

[0158] If the write_protect_flag Is set to 1, the contents of the PlayList are not erased nor changed except the 
^ writej3rotect Jlag. If this flag is set to 0,. the user is free to erasQ or change the PlayList. if this flag is set to 1 . the 
recording and/or reproducing apparatus 1 demonstrates a message requesting re-confimrtation by the user before the 
user proceeds to erase, edit or overwrite the PlayList. 

[0159] The Real PlayList, in which the wrlte_j3rotect_f lag Is set to 0, may exist, the Virtual PlayList, referencing the 
Clip of the Real PlayList may exist, and the write^protectjlag of the Virtual PlayList may be set to 1. If the user is 
so desirous to erase the Real PlayList, the recording and/or reproducing apparatus 1 issues an alarm to the user as to 
tiie presence of the aforementioned Virtual PlayList or "minimizes" the Real PlayList before erasing the Real PlayList. 
[0160] If is jDlayed Jlag is set to 1 , as shown In Fig.28B, It indbates that the PlayList was reproduced at least once 
since it was recorded, whereas, if It is set to 0, it indicates that the PlayList was not reproduced even once since it was 
recorded. 

55 [0161] Archive is a two-bit field indicating whether the PlayList is an origlnal or a copy, as shown in Fig,28C. The 
field of ref^unnbnailjndex Indicates the infomiatlon of a thumbnail picture representative of the PlayList If the 
refjhumbnalljndex field Is of a value other than OxFFFF, a thumbnail picture representative of the PlayList is added 
in the PlayList, with the PlayList being stored in the menu.thmb file. The picture is referenced using the value of 
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reLthumbnallJndex In the menu.thmb file. If the refjhumbnalljndex field is OxFFFF, no thumbnail picture represent- 
ative of the PlayLlst is added In the PlayList. 

[0162J The Playltem Is hereinafter explained. One Playltem() basically contains the following data: 
Clip^lnformailonJMe.name for specifying the filename of the Clip, IN-time and OUT-time, paired together to specify 
5 the playback domain of Clip, STC.sequenceJd referenced by IN-tlme and buT-Clme in case the CPLtype defined In 
FleyLlslO is EP.map type, and Connectlon.Condlllon Indicating the conneclion condtlon of previous Playltem and 
current Playltem. 

[0163] If PlayLlst is made up of two or more Play Items, these Play Items are an-ayed In a row, without temporal gap 
or overlap, on the global time axis of the PlayUst. If CPLtype defined In the PlayLlst is EP^nwip type and the current 

10 PlayLlst does not have the BridgeSequence(), the.lN-time and OUT-time pair must Indicate the same time on the STG 
continuous domain as that specified by the STC_sequenco_ld. Such Instance is shown in Flg.29. 
[01641 Fig.30 shows such a case In which the CPLtype defined by PlayList{) and, if the current Playltem has the 
BridgeSequenceO, the rules as now explained are applied. The INJime of the Playltem previous to the current Play- 
ltem, shown as INIJImel , indicates the time in Bridge-Clip specified In the BridgeSequencelnfoQ of the current Play- 

is Item. This OUTjlme must obey the encoding limitations which will be explained subsequently. 

[0185] The INjIme of the current. Playltem, shown as IN_tlme2, Indicates the time In Bridge-Clip specified In the 
BrfdgeSequencelnfoO of the current Playltem. This INjIme also must obey the encoding limitations as later explained. 
The OUTjlme of Playltem of the cun-enl Playltem, shown as 0UT_tlnne2, Indicates the time.on the STC continuous 
domain specified by STC.sequenbceJd of the cun^ent Playltem. 

^ [0166] If the CPLtype of PlayLlstO is TU^map type, the IN^dme and OUTjlme of Playltem, paired together, indicate 
the time on the same Clio AV stream, as shown In Fig.31 . 

[0167] The Playltem syntax is as shown In Flg.32. As to the syntax of the Playltem, shown in Flg.32. the field of the 
Clip Jnformation_flle_name indicates the filename of the Clip Infonnatlon. The Cllp^stream^type defined by the CHplnfo 
0 of this Clip Information file must indicate the Clip AV stream. 
25 [0168] The STC_sequenceJd is an 8-blt field and Indicates the STC_sequenceJd of the continuous STC domain 
referenced by the Playltem. If the CPLtype specified in the PiayLlstQ is TU_map type, this 8-blt field has no meaning 
and Is set to 0. IN JIme is a 32-bit field end used to store the playback start time of Playltem. The semantics of INJime 
differs with CPLtype defined in the PlayLlst(), as shown In Flg.33. 

[01 69) OUTjime is a 32-bit field and Is used to store the playback end time of Playltem. The semantics of OUTjlme 
30 differs with CPLtype defined in the PlayList(), as shown in Flg.34. 

[0170] Connection_condition is a 2-bjt field indicating the connection condition between the previous Playltem and 
the current Playltem, as shown in F/g.35. Figs.36A to 36D illustrate various states of Connection.condltlon shown in 
Flg.35. 

[0171] BrIdgeSequencelnfo Is explained with reference to Flg.37. This BridgeSequencelnfo Is the ancillary Informa- 
3s tlon of the current Playltem and includes the following infomnation. That is, BridgeSequencelnfo Includes 
er1dge_Cllp_lnfonnatlonJlle_name for specifying the Brldge^ClIp AV file and a Bridge_Clip_rnfomiatlonJlle_name 
specifying the corresponding Clip Information fife (Flg.45), 

[0172] It Is also an address of a source packet on the Clip AV stream referenced by the previous Playltem. Next to 
this source packet Is connected the first source packet of the Bridge-Clip AV stream. This address is temied the 
^ RSPN_exltJromj3rovlous_Clip. It is also an address of the source packet on the Clip AV stream referenced by the 
current Playltem. Ahead of this source packet is connected the last source packet of the Bridge^cilp AV stream file. 
This address is tenried RSPN_©nterJo_current_Cllp. 

[0173] In Fig.37, RSPN_arrivalJime_dlscontlnulty Indicates an address of a source packet In the Brldge^Cllp AV 
stream where there Is a discontinuous point in the arrival time base. This address is defined In the CliplnfoO (Fig.46). . 
^ [0174] Fig.38 shows the syntax of the BridgeSequencelnfo. Tuming to the syntax of BridgeSequencelnfo shown In 
Fig.38, the field of Bridge.ClipJnfomiatlonJlle.name Indicates the filename of the Clip Infonmation file corresponding 
to the Brtdge_Clip_lnformatton_flle. The Cllp_stream„type defined In CliplnfoO of this Clip information file must Indtoate 
•Bridge_CllpAV stream*. 

[0175] The 32-blt field of the RSPN.exitJromj)revious_Cllp is a relative address of a source packet on the Clip AV 
so stream referenced by the previous Playltem. Next to this source packet is connected the first source packet of the 
Bridge^Cllp AV stream file. The RSPN^exIt Jromj)revlous_Clfp has a size based on the source packet number as a 
unit, and is counted with the value of the offset.SPN defined In the CliplnfoO from the first source packet of the Clip 
AV stream file referenced by the previous Playltem. 

[0176] The 32-bit field of RSPN_enterjo,curent_Cilp Is the relative address of the source packet on the Clip AV 
*5 stream referenced by the current Playltem. Ahead of this source packet is connected the last-source packet of the 
Bridge_;Clip_AV stream file. The RSPN_enterJo_curent_Cllp has a size that Is based on the source-packet number 
as a unit. The RSPN_enterJo_curent_Clip Is counted with the value of the offset^SPN, defined In the CliplnfoO 'ran^ 
the first source packet of the Clip AV stream file referenced by the current Playltem, as en Initial value. 
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4 [01771 : The SiibPlayltem is explained with reference to Flg.39: The use of SubPlayltemQ Is permitted only if the 

1 CPLtype of the PlayLlst{) is the EP__map type. In the present embodiment, SubPlayltern Is used only for audio post 

I recording. The SubPlayltem() includes the following data. First, It includes Cllpjnfonnriationjlle^name for specifying 

I . the Clip referenced by the sub path in the PiayList. 

I 5 [0178]. It also Includes SubPathjKl_tlme and SubPath.OUTJme for specifying the sub path playback domain In 

\ ' . the Clip. Additionally, It includes sync^PlayltemJd and start_PTS_of_Playltem for specifying the time of starting the 

I sub path reproduction on the main path time axis. The Clip AV stream, referenced by the sub path, must not contain 

\ STC discontinuous points (discontinuous points of the system time base). The clocks of audio samples of the Clip used 

? in the sub path are locked to the clocks of the audio samples of the main path. 

j io [0179] Fig.40 shows the syntax of the SubPlayltem. Turning to the syntax of the SubPlay Item, shown in Fig.40, the 

1 field of the CIip_lnformation.fllel.name Indk^ates the filename of the Clip Information file and Is used by a sub path In 

I the PiayList. The Clip_stream„type defined in this CGplnfoQ must Indicate the Clip AV stream. 

I [01801 An 8rbtt field of sync.PlayltemJd indicates the sub path type. Here, only '0x00' is set, as shown in Fig.41 , 

I while other values are reserved for future use. 

I 1^ [01811 The 8->bit field of sync.PlayltemJd indicates the Playltemjd of the Playltem containing the time of playback 

i start of the sub path on the time axis of the main path . The value of Playltemjd corresponding to the preset Playltem 

r is defined in the PlayListO (Fig.25). 

I [01821 A 32-bit field of sync_start_PTS„of_Playltem denotes the time of playback start of the sub.path on the time 

I axis of the main path, and denotes the upper 32 bits of the PTS (presentation time stamp) on the Playltem referenced 

I 20 by the sync_.PIayltemiid. The upper 32 bit field of the SubPath JN jime stores the playback start time of th e sub path . 

I SubPath JNJme denotes upper 32 bits of the PTS of 33 bits corresponding to the first presentation unit in the sub path . 

I [0183] Theupper32bitfleldofsubPath_OUTJImestorestheplaybackendtimeof thesubpath, SubPath_OLrT_tlme 

! indicates upper 32 bits of the value of the Presentatlon_:endjrs calculated by the following e^quatlon: 
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Presentaition_end„TS = PTS_OUT + AU^duratlon 


j where PTS_out is the PTS of the 33 bit length corresponding to the last presentation unit of the SubPath and 

I AU^duration is the 90 kHz based display period of the last presentation unit of the SubPath, 

I 30 [0184] Next, PlayU?tMark() in the syntax of xxxxx.rpis and yyyyy.vpls shown in Fig^S Is explained. The mark infor- 

j mabon pertinent to the PiayList is stored in this PlayListMark, Fig.42 shows the syntax of PlayListMark. Turning to the 

I syntax of the PlayListMark shown in Flg.42, version„number Is four character letters Indicating the version number of 

I this PlayUstMarkQ. The versioh.number must be encoded to '^0046" In accordance with ISO 646. 

j [0185] Length Is an unsigned 32-blt integer indicating the number of bytes of PlayLlstMark() from directly after the 

I 35 length field to the trailing end of the PlayUstMarkQ. the number_of_PlayListMarks is a 1 6-bit unsigned integer indicating 

I the number of marks stored In the PlayListMark. The number_of^PlayLlstMarks may be zero. The mark^type is an 

I 8-bit field indicating the mark type and is encoded In the table shown in Rg.43. 

I [01 861 A 32-bit filed of mark_tirne_stamp stores a time stamp indicating the point specified by the mark. The seman- 

I ttes of the markjime.stamp differ with CPLtype defined in the PlayListO, as shown in Rg.44. The Playltemjd is an 

I 40 8-bit field specifying the Playltem where the mark is put. The values of Playltemjd corresponding to a preset Playltem 

\ is defined in the PlayUstO (see Fig.25). 

I [01871 An 8-blt field of character_set shows the encoding method of -character letters encoded in the mark_name 

\ fietd. The encoding method corresponds to values shown In Fig. 1 9. The 8-bit field of namejength indicates the byte 

I length of the mark name shown in the mark_name field. The mark_name field denotes the mark name indicated in the 

I 45 mafk_name field. The number of bytes corresponding to the number of name_lengths from left of this field is the 

j effective character letters and denotes the mark name. In the mark_name field, the value next following these effective 

( character letters may be arbitrary. 

I [0188]~ The field of the ref jhumbnailjndex denotes the information of the thumbnail picture added to the mark. If 

i the field of the ref Jhumbnaljjndex is not.OxFFFF, a thumbnail picture is added to its. mark, with the thumbnail picture 

I so being stored In the mark.thmb file. This pteture is referenced In the rTiark:thmb file, using the value of 

|. ref^thumbnailjndex, as explained subsequently. If the ref JhumbnalLlndex field is OxFFFF, it Indicates that no thumb- 

j nail picture is added to the mark. . 

j [0189| The Clip Information file is now explained.. The zzzzz.clpl (Clip Infomiation file) Is made up of six objects, as 

I shown in Fig.46. These are Cllplnfo(), STC_lnfp(), Program(). CPI(). CI?)Mark() and MakersPrivateData(). For the AV 

I' 55 stream (Clip AV stream or BridgeTCIIp AV stream) and the con-esponding Clip Infonnation file, the same string of nu- 

i merals "zzzzz" Is used. • 

l [0190]' Turning to the syntax of zzzzz.clpi (Clip Infomiation file) shown in Fig.45 is explained. The 

: Cliplnfo_Start_address indicates the leading end address of Cliplnfo() with the relative number of bytes from the leading 
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end byte of the zzzzz.clpi file as a unit. The relative number of bytes is counted from zero. 
[01 91 ) The STC^Info_Start_addres8 indicates the leading end address of STC:^I nfo with the relative number of bytes 
from the leading end byte of the zzzzz.clpi file as a unit. The Programlnf6_Start_address Indicates the leading end 
address of Program!nfo{) with the relative number of bytes from the leading end byte of the zzzzz.clpi file as a unit. 
5 The relative number of bytes Is.counted from 0. The CPI_Stan_address Indicates the leading end address of CPiQ 
with the relative number of bytes from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes 
is counted from zero. 

. [0192] The CiipMark^Start^address indicates the leading end address of ClipMarl^O with the relative number of bytes 
from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes is counted from zero. 

• 10 The_Maker8PrivateData Start^address indicates the leading end address of MakersPrlvateData() with the. relative 
number of bytes from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes Is counted from 
zero. The padding^word is inserted In accordance with the syntax of the zzzzz.clpi file. N1 , N2, N3, N4 and N6 must 
be zero or optlonai positive integers. The respective padding words may also assume optional values. 
[0193] The Cllplnfo Is now explained. Flg.46 shows the syntax of Clipinfo. Flg.46 shows the syntax of Cllplnfo. In 

15 . the CliplnfoO is stored the attribute infonnatioh of corresponding AV stream files (Clip AV stream or Bridge-Clip AV 
stream file). 

[019^]. Turning to the syntax of the Cllplnfo shown In Fig46, version_r1umb9r is the four character letters Indicating 
the version number of this Cliplnfo(). The verslon^number must be encoded to "0045" in accordance with the ISO 646. 
Length is a 32-bit unsigned integer Indicating the number of bytes of CliplnfoO from directly at back of the length field 
20 to the trailing end of the CliplnfoO. An 8-blt field of Cllp^stream_type indicates the type of the AV stream corresponding 
to the Clip Information file, as shown in Flg.47. The stream types of the respective AV streams will be explained sub- 
sequently 

[0195] The 32-bit field of off8et_SPf^ gives an offset value of the source packet number of the first source packet 
number of the first source packet of the AV stream (Clip AV stream or the Bridge-Clip AV stream) . When the AV stream 

25 file is first recorded on the disc; this offsel^SPN must be zero. 

[0196] Refen-ing to Fig.48, when the beginning portion of the AV stream file is erased by editing, offset_SPN may 
assume a value other than-0. in the present embodiment, the relative source packet number (reiathfe address) refer- 
encing the offset_SPN is frequently described In. the fonm of RSPNxxx, where xxx is modified such that RSPN_xxx is 
RAPN_EP„starl. The relative source packet number is sized with the source packet number as a unit and Is counted 

30 from the first source packet number of the AV stream file with the value of the offset^SPN as the Initial value. 

[01 97] The number of source packets from the first source packet of the AV stream file to the source packet referenced 
by the relative source packet number (SPN^xxx) is calculated by the following equation: 

^ SPM^xxx= BSPisj_xxx-offset_SPN. 

Fig. 48 shows an instance In which offset_SPN is 4. 

[0198] TS_recording.rate is a 24-blt unsigned Integer, which affords an Input/output bit rate required for the AV 
stream to the DVR drive (write unit 22) or from the DVR drive (readoutunit 28). The record_time_and_date Is a 56-bit 
^ field forstoring the date and time of recording of the AV stream corresponding to the Clip and is an encoded represen- 
tation of year/month/day/hour/minute In 4-bit binary coded decihial (BCD) for 14 numerical figures. For example, 
2001/2/23:01:02:03 Is encoded to "0x20011223010203". 

[0199] The duration Is a 24-blt field Indicating the total playback time of the Clip by hour/minute/second based on 
arrival time clocks. This field is six numerical figures encoded in 4-blt binary coded decimal (BCD). For example, 01 : 
45 45:30 IS encoded to "0x014530". 

[0200] A flag time.oontrolledjlag indicates the recording mode of an AV stream file. If this time.controlledjiag Is: 
1 , It Indicates that the recording mode Is such a mode In whteh the file size Is proportionate to the time elapsed since 
recording, such that the condition shown by the following equation: 

50 

Ts_average_raleM92/188*(t - start_time)- a <=: size.clip(t) 
<= TS_average_rate*19^18a*(t - startjime) + a 

55 where TS.average^rate Is an average bit rate of the transport stream of the AV stream file expressed by bytes/second. 
[0201]' In the above equation, t denotes the time In seconds, while start JIme Is the time point when the first source 
. packet of the AV stream file was recorded. The size_cllp(t) Is 10* 192. bytes and a Is a constarit dependent on 
TS_average_rato. 


18 


EP1 ig8133A1 

• 4?^ ^^'^'-^ ''^^-'^ ^'•^^ • * . • 

[0202] If tlme^controlledjag is set to p, It indicates that the recording mode Is not controlling so that the time lapse 
of recording Is proportionate to ttie file size of the AV stream^ For example, the input transport stream is recorded in a 
transparent fashion. 

[0203] If tlme^controlled Jag is set to 1 , the 24-bit field of TS^average^rate indicates the value of TS_average_rate 
used In the above equation. If time_controled_flag is set to' 0, this field has no meaning and must be set to o7 For 
example, the variable bit rate transport stream is encoded by the following sequence: First, the transport rate is set to 
the value of TS.recordingLrale. The video stream is encoded with a variable bit rate. The transport packet is intermit- 
tently encoded by not employing null packets. 

[0204] The 32-bIt field of RSPN_amval_tlme_discontinulty Is a relative address of a site where arrival timebase 
discontinuities are produced on the Bridge^lip AV stream file. The RSPN_arrival_time.discontinuity is sized with the 
source packet number.as a unit and is counted with the value of offset^SPN defined in the Cilpinfo() as from the.flrst 
source packet of the Bridge-Clip AV strearn file. An absolute aidfdress in the Bridge-Clip AV stream file Is calculated 
based on the aforementioned equation: 

SPN.XXX = RSPN.xxx - offeeLSPN. 

[0205) The 144-bit field of reserverj6r_system_use is reserved for a system. If isjormatjdentifier.valid flag is 1 , 
it indlciates that the field of formatjdentlfler is effective. If is_fomiat^identifler_valid flag is 1, It indicates that the 
forhiatjdentifier field is valid. If is_orlginaLrietworkJD_valid flag is 1. It indicates that the field of 
is^transport^streamJD-valid Is valid. If the flag isJransport.streamJD-yalid is 1, it indicates that the 
transport^streamJD field is valid. 1f fe_servece JD_valid flag is 1 , It indicates that the sen/ece_ip field is valid. 
[0206] If ls_country code:.valld flag Is 1 , it indicates that the field country_code is valid. The 32-bit field of 
format Jdentlfier in dicates the value of f omiat Jdentif ler owned by a registriation. descriptor (defined in ISO/I EC1 381 8-1 ) 
in the transport stream. The 1 6-blt field of orlginal_network_ID indicates the value of the originai_netwofk_ID defined 
in the transport stream. 

[0207] The 1 6-bit field in servece_ID denotes the value of servece_ID defined in the transport streanri. The 24-bit 
field of country^code shows a country code defined by ISOiSI 66. Each charactercode is encoded by IS08859-1. For 
example, Japan is represented as "JPN" and is encoded to "Ox4A 0x50 0x4E". The stream Jomiat_namets 1 5 character 
codes of ISO-646 showing the name of a fomiat organization affording stream definitions of transport streams. An 
invalid byte in this field has a value of 'OxFF. 

[0208] Fomrialjdentffier, origin aLnetwortc_iD, transport^stream^lD, servece.lD, country^code and 
stream_lformat_r}[ame Iridlcate service providers of transport streams. This allows to recognize encoding JImitations on 
. audio or video streams and stream definitions of private data streams other than audio video streams or SI (service 
infonnation). These information can be used to check if the decoder is able to decode the stream, if such decodirig is 
possible, the infomnatjon may be used to initialize the decodersystem before starting the decoding. 
[0209] STG^Info is now explained. The time domain in the MP EG-2 transport stream not containing STC discontin- 
uous ppints(dlscontinuous points of the system time base) liS temied the STC_sequence. in the Clip, STC_sequence 
is specified by the value of STC^sequenceJd. Figs.SOA and SOB illustrate a continuous STC domain. The same STC 
values never appear In the same STC_sequence, although the maxirrium tine length of Clip is limited, as explained . 
subsequently. Therefore, the same PTS values also never appear in the same STC_sequence. If the AV stream contains 
N STC discontinuous points, where N > 0, the Clip system time base Is split into (N+l ) STC_sequen<SeS. 
[0210] StCJnfb stores the address of the site where STC discontinuities (system timebase discontinuities) are pro- 
duced. As explained with reference to Fig.51 , the RSPN^STC^start indicates the address and begins at a time point 
of arrival of the source packet referenced by the (k+1)st RSPisi_stC_i5tart and ends at a time point of arrival of the 
last source packet. 

[021 1] Fig.52 shows the syntax of the STC_lnfo. Turning to the syntax of STC Jnfo shown in Flg.62, version jumber 
is four character letters indicating the version number of STC JnfoQ. The ver^sloh.nuniber must be encoded to "0045" 
In accordance with ISO 646. 

[0212] Length is a 32-brt unsigned integer Indteatingthe number 6f bytes of STC Jnfo() from dlrec^y after this length 
fiekl to the end of STC.Infd. If CPLtypeof CPI() indicates TUl^map type, 0 may be set in this length field.- If CPLtype 
of CPjO Indicates EP^niap type, the num_of_STC_s^querice mut be of a value not less than 1 . 
[0213J Ah. 8-bit unsigned integer of num_of_STCi.sequence indicates the number of sequences in the Clip; This 
value Indicates the number of the for-loops next following the field. The stc^sequencejd con-esponding to the preset 
STC^sequence is defined by the order in which appeal^ the RSPN^STCjstart corresponding to the STC_sequence 
in the for-loop containing the RSPN_STC_.start. The STC^sequenceJd commences at O; 

[0214] The 32-bit field of R5PN_STC_start indicates an address at which the STC_.sequence commences on the 
AV stream file. RSPN_STC_start denotes an address where system time base discontinuities are produced in the AV 


EP1 198 133 A1 


stream file. The RSPN.STC_start may also be a relative address of the source packet havlng the first PCR of the new 
system time base In the AV stream. The RSPN^STC^stait Is of a size based dn the source packet number and Is 
counted from the first source packet of the AV stream file with the offset^SPN value defined In Cllplnto() as an Initial 
value. In this AV stream fiie^ the absolute address is calculated by the above-mentioned equation, that |s 

5 

SPN„)ooc = RSPN^xxx - offseLSPN. 

[0215] Programlnfo In the syntax of zzzz.clip shown In Flg,45 Is now explained with reference to Fig.53. The time 
10 domain having the follovying features In the Clip Is ternied program_sequence. These feature are that the value of 
PCR^PiD Is not changed, the nunnber of audio elementary streams Is also not changed, the PiD values In the respeotivo 
video streams are not changed, the encoding infomiatlon which Is defined by VIdeoCodlnglnfo thereof Is not changed, 
the number of audio elementary streams is also not changed, the PID values of the respective audio streanr^s are not 
changed, and that the encoding infonnatlon, which is defined by AudloCodinglnfo thereof, is not changed. 
IS [021 6] Program^sequence has only one system time base at the same time point. Program.sequence has a sole 
PMT at the same time point. Programihfo() stores the address of the site where the program^sequehce commences. 
RSPNj3rogram_sequence-start Indicates the_address. 

1021 71 Fig.54 illustrates the syntax of Programlnfo. Turning to the Programlnfo shown In. Flg.54, version^number Is 
four character letters indteating the version number of Pragraminf o(). The verslon^number must be encoded to "0045" 

20 In accordance with ISO 646. 

[02181 Length Is a 32-bit unsigned integer indicating the number of bytes of ProgramlnfoO from directly at back of 
this length field to the end of program(lnfo(). If CPLtype of CPI() indicates the TU_maptype, this length field may be 
set to 0. Jf the CPLtype of CPI() indicates EP^map type, the number^of jarograms must be of a value not less than 1 . 
[021 91 An 8-brt unsigned integer of number_of_program_sequences denotes the number of program_sequences In 

25 the Clip. This value Indicates the number of for-loops next following this field. If program^sequence .ln the Clip Is not 
changed, 1 rriust be set In the number of program^sequences. A 32-bft field of RSPN_program_8equence_8tart is a 
relative address where the program sequence commences on the-AV stream. 

[0220] RSPN_j)rogram_6equence_6tart is sized with the source packet number as a unit and is counted with.the 
value of offset.SPN deflried in the Cliplnfo() as from the first source packet of the AV. stream file. An absolute address 
^ in the AV stream file Is calculated by: 

SPN^xxx = RSPN^Xxx - off6et_SPISI. 

35 The values of RSPN_program_sequence_staft in the for-loop syntax must appear In the rising order. 

[02211 A 1 e-bk f lekJ of PCR.PID denotes the PID of the transport packet containing an effective PCR field effective 
for the program_sequence. An 8-bit field of number_of_audl05 Indicates tlie. number of for-loops containing 
audi o^Btream^PlD and AudloCodlnglnfo(). A 16-bit field of video^stream^PID Indicates the PID of the transport packet 
containing a video stream effective for itsprogram.sequence. VideoCoding!nfo(), next following this field * must explain 

^ the contents of the video stream referenced by Its vldeo_8tream_PID. 

[02221 A 1 6-blt field of audlo^stream.PID Indtoates the PID of a transport packet containing the audio stream effective 
for Its program sequence. The AudloCodlnglnfoQ, next following this fiekj, must explain thecontents of the video stream 
referenced by its audio_8tream„PID. 

[0223] The order in which the values of vjdeo^stream.PID in the f pr-loop of the syntax must be equal to the sequence 
4s of PID encoding of the video stream In the PMT effective for the program^sequence. Additionally, the order In which 
the values of audio_stream_PID appears In.the for-loop of the syntax must be equal to the . sequence of PID encoding 
of the audio stream in the PMT effective -for the program^sequence. 

[0224] Flg.55 shows the syntax of VIdeoCbdInglnfo in the syntax of the Programlnfo shown in Flg,54, Tiimlngto the 
syntax of the VideoCodIng info shown in Flg.55, an 8-blt field of video Jomnat Indtoates the video format corresponding 
so to vldeo^stream^PID In ProgramlnfoO, as shown In Flg.56. 

[0225] Referring to Flg.57, an 8-bit field of frame^rate Indicates the video frame rate corresponding to the 
video_8tream_PID in ProgramlnfoO . An 8-blt field of dlsplay^aspect^ratio Indicates a video display aspect ratio corre- 
sponding to video_stream_PID in ProgramJnfo(), 

[0226] Fig.59 shows the syntax of AudloCodinglnfo in the syntax of Programlnfo shown in Fig.54. Turning to the 
» syntax of the AudloCoding Info shown In Ffg.59, an 8-bit field of audio Jomiat Indicates the audio encoding method 
corresponding to audio^streariri.PID In Programlrifo(), as shown In Flg.60. 

[0227] An 8-bit field: of audlo_component_type indicates, an audio component type con-esponding to 
audiojtream^PID In ProgramlnfoO as shown In Flg.61 , whilst an 8-blt field of sampling Jrequency indicates an audio 
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sampling frequency corresponding to audlo_stream_PID In ProgramlnfoQ as shown In Fig.62. . 
[0228] The CP! (Characteristics Point Infcmnation) In the syntax of zzzzz.clip shown in Fig.45 is explained. The CPI 
; Is usedforcorrelaitlngthetime inforrnation In the AV stream with the address In Its file^ Is of two types, namely 

EP_map and TU.map.. in Fig,63, if CPI^type In CPiO is EP.map, its CPI() contains EP_map. In Flg.64, if CPi_type in 
5. CPI() Is TU^map, Its CPIQ contains TU^map. One AV stream has one EP^map or one TU^map. if the AV stream Is 
an SESF transport stream, the con^espondihg Clip must own an EP_map. 

[0229] Fig.65 show the syntax of CPI. Turning to the syntax of CPi shown In Flg.65, the version^number is four 
character letters indicating the version number of this CPi(), The version.number must be encoded to "0045" in ac- 
cordance with ISO 646. length Is a 32-blt unsigned Integer Indicating the number of bytes as from directly after this 
10 length field to the trailing end of the CPIQ* The CPLtype Is a 1 -bit flag and indicates the CPI type of Clip, as shown in 
* l^g.66.. 

[0230] The EP_map in the CPI syntax shown in Fig. 65 is explained. There are two types of the EP_map, that is 
EP_map for a video stream arKi an EP_map for an audio stream. The EP_map_type in the EP_map differentiates 
between these EP_map types. If the Clip contains one or more video streams, the EP_map for the video stream must 
IS . be used, if the Clip does not contajn a video stream but contains one or nrN>re audio streams, the EP„map for the audio 
stream must be used. 

[0231 1 The EP_map for a video stream is explained with reference to Fig.67. The EP_map for the video stream has 
data stream^PID. PTS_EP_start and RSPN_EP_start. The strean\.PID shows the PID of the transport packet trans- 
mitting a video stream. The PTS.EP^start indicates the PTS of an access unit beginning from the sequence header. 
^ of the video stream. The RSPN_.RP_start indicates the address of a source paci^et including the first byte of the access 
unit referenced by the PTS.EP_start in the AV stream. 

[0232] A sub table, termed EP_mapJoLone_stream.PiD() Is created from one video stream transmitted by the 
transport packet having the same PID to another. If plural video streams exist In the Clip, the EP^ntap may contain 
plural EP_mapJor_one_streanuPID(). 
^ [0233] The EP_map for audio stream has data stream_PID, PTS_EP_stan and RSPN.EP^start. The stream_RD 
. shows a PID of a transport padcet transniitting an audio stream. The PTS_EP_start shows the PTS of an accessing 
unit in the audio stream. The RSPN_EP-start Indicates an address of a source packet containing a first byte of the 
access unit referenced by PTS_EP_start of the AV stream. 

[0234] The sub table termed EP_mapJor_one_stream_PIDO Is created from one audio stream transmitted by the 
30 transport packet having the same PID to another, if there exist plural audio streams In the Clip, EP_map may contain 
plural EP map- Jor^one stream^PIDO- 

[0235] Turning to the rejatton between EP_map and .STC_lnfo, one EP_mapJor_one_stream_PIDO is created In 
. one table In^espectlve of discontinuous points in the STC. Comparison of the value of the R3PN.EP_start to the value 
of RSPN_STC„start deflried In STCJnfoQ reveals the boundary of data of EP_map belonging to respective 
35 STC.sequences (see Flg.6S), The EP_map must have one EP_n1apJ.or_one_stream_PID for a continuous stream 
- range transmitted by the same PID.- In the case shown in Fig.69, program#1 and program#3 have the same video PID, 
however, the data range Is not continuous, so that EP_map_for_one_strefimi_PID must be provided for each program. 
[0236] Fig.70 showai the EP^map syntax. By way of explanation of the EP_map syntax sshown In Flg.70, the EP_type 
V is a 4-bit field end shows the EP_map entry point type, as shown in Fig.71 . The EP^type shows the semantics of the 
40 data field next following this field. If Clip includes one or more video stream, the EP_type must be set to 0 (Video*). 
Aitematively, if the Clip contains no video stream but contains one or more audio stream, then EP_type must be set 
to 1 ('audio'). 

[0237] The lerbit field of number_of_stream_PIDs indlcates the number of times of loops of the for-loop having 
number.of_stream_PIDs in the EP_map() as a.variable. The 16-bit field of stream_PID(k) indicates the PID of the 
45 transport packet transmitting the number k elementary stream (video or audio stream) . referenced by 
EP_mapJor_onejstream_Pip (num_EP_entries(k». If EP Jype is 0 Cvideo'), its elementary stream must be a video 
stream. If EP^type is equal to 1 ('audio'), its elementary stream must be the audio stream. 

[0238] The 16-bit field of num_EP_entries(kj indicates the num_EP_entries(k) referenced by EP_map_entrres(k)). 
The EP^map Jor_one„stream_Pip_ Start_address(k): This 32-bit field indkrates the relative address position at whk^h 
so the EP_mapJor_one.stream_PID(num_EP_entries(k)) l>eglns in the EP_mapO. This value is indteated by the size as 
from the first byte of the EP^mapQ. . 

[0239] Padding_word must be inserted in accordance with the EP_mapO syntax. X and Y must be optional positive 
Integers. The respective padding words may assume any optional values. 

[0240] Fig.72 shows the syntax of EP_map_for_one_stream_PID. By way of explanation of the. syntax of the 
55 EP^mapJor_one_stream_PID shown In Fig.72, the semantics of the 32-bit field of PTS_EP_start differs with the. 
EPjype defined by EP_map(). If EPJype is equal to 0 (Video*), this field has upper 32 bits of the 33-bit precision PTS 
-of the access unit beginning with a sequence header of the video stream. If the EP_type is equal to 1 ('audto'), this 
field has upper 32 bits of PTS of 33 bit precision of the.access unit of the audio stream. 
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[0241] The semantics of the 32-bit field of RSPN^EP^start differs with the EP.type defined Jn EP.map(). If EP^type 
Is equal to 0 (Video% this field indicates the relative address of the source packet Including the first byte of the sequence 
header of the access unit referenced by the PTS.EP^stait In the AV stream. AltematlveJy, if EP.type is equal to 1 
('audio'), this field Indicates the relative address of the source packet containing the first byte )n the audio stream of 
5 the access unit referenced by the PTS_EP_start In the AV stream. 

[0242] RSPN_EP_start Is of a size which is based on the source packet number as a unit, and is counted from the 
first source packet of the AV stream file, with the value of the offsel.SPN, defined In Cllplnfo(). as an initial value. The 
absolute address In the AV stream file is calculated by 

10 

SPN^xxx = RSPN_xxx - offset^SPN. 

[0243] It Is noted that the value of the RSPN:.EP^8tart In the syntax must appear In the rising order. 
[0244] The TU^map is now explained with reference to Flg73. TU^map forms a time axis based on the source 
IS packet anlval time clock (timepiece of the arrive time base). Thip time axis Is temfied TU.map_tlme_axls. The point of 
origin of TU_map_tlme„axis is Indfcated by offset JIme In the TiJ_map(). TU.map.tlmejxis is divided In a preset unit 
as from offset^tlme, this unit being temned time_unlt. 

[0245] In each time^unlt in the AV stream, addresses on the AV stream file of the source packet in the first complete 
form are stored In TU_map. These addresses are temied RSPN.tlma.untt^start. The time at which begins the k(k ^ 
so o)th time.unft on the TU_mapJime_axi8 is tenned TU_startJlme(k). This.value is calculated based on the following 
equation: 

TU_8tart Jime(k) = offset Jime + knime_unit_stee. 

25 

[0246] It is noted that TU_startJime(k) has a precision of 46 kHz. 

[0247] Flg.74 shows the syntax of TU^map . By way of explanation of the TU^map syntax shown In Fig.74, the 32-bit 
field of offset Jime gives an offset time relative to TO_mapjime_axls. This value Indicates the offset time relative to 
the first time.unit in the Clip. The offseUime is of a size based on 45 kHz clock derived from the 27 MHz precision 
30 arhval time ckx:ks as unit. If the AV stream is to be recorded as new Clip, offset-time must be set to 0. 

[0248] The 32-bit field of time^unlt^size affords the size of the time^unlt, and is based on 45 kHz clocks, derived 
from the 27 MHz precision arrival time clocks, as unit. Preferably, tlme_unlt_sfze Is not longer than one second 
(tIme.unMlz© s 45000). The 32 bit field of nunf*er_ot_tlme_unlt_entr1es indicates the number of entries stored in 
TU^mapO. 

55 [0249] The 32-blt field of RSNJlme.unit^start indicates the relative address of a site In the AV stream at which 
begins each time^unll. RSN_tlme_unlt_8tart is of a size based on. the source packet number as unit and Is counted 
with the value of offset^SPN defined In Clipl nfo() as from the first source packet of the AV stream file as an Initial value. 
The absolute address In the AV stream file is calculated by 

40 

. SPN_xxx=RSPN_xxx-off8et_SPISI. 

[0250] It is noted that the value of RSN_tlme„unlt_start In the for-loop of the syntax must appear in the rising order, 
if there Is no source packet In the number (k+1) tlme_unlt, the number (k+1) RSN_tlme_unlt_start must be equal to 
^ the number k RSPN_time_unit_start. 

[0251] By way of explanation of the CllpMark In the syntax of zzzzz.cllp shown In Fig.45, the CllpMar1< Is the. mark 
infomnation pertinent to clip and Is stored In the CllpMark. This mark is not set by a user, but is set by a recorder 
(recording and/or reproducing apparatus 1). 

[0252] Fig,75 shows the CllpMark syntax. By way of explanation of the CllpMark syntax shown in Fig.75, the 
so verslon^number is four character letters indicating the version number of this CllpMark. The version_number must be 
encoded in accordance with ISO 646 to '0045". 

[0253J Length is a 32-bit unsigned integer indicating the number of bytes of the CilpiVlarkO as from directly after the 
length field to the trailing end of CiipMarkQ. The number_of_Cllp_marks is a 16-bit unsigned integer indicating the. 
number of marks stored in aipMark and may be equal to 0. Mark Jype Is an 8-blt field indicating the nrmrk type and is 
55 encoded In accordance with the table shown In Flg.7@. 

[0254] IVIark.time^stamp is a 32-blt field and stores the time stamp Indicating a pointer having a specified mark. The 
semantics of mark_tlme_stamp differs with CPI^type In the PlayLl8t(), as shown In Fig. 77. 

[0266] If CPl.type In CPI() Indicates the EP^map type, this 8-blt fietel indtoates the STC^sequenceJdof the contin- 
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U0U8 StC domain where there Is placed marletlme^stamp. If CPLtype In CP l() indicates TU_map type, this 8-bit field 
has no meaning but . is set ta 0. The 8-bit field of Character.set indicates the indicating method of character letters 
encoded in the mark_name f feld. The encoding method coaesponds to the value shown In Fig. 19. 
[0256] The 8-blt field of hame_tength indicates the byte length of the mark name shown in the ma 

5 mark.nanoe field Indicates the mark name. The byte niRnber corresponding to the number of the hamejength from 
left of this field Is the effective cfiaracter number and denotes the mark narne/ln the mark^name field; the values next 
' following these effective character letters may be arbitrary^ 
[0?57] The field of ref^thumbnaltjndex indicates the infomnation of the thumbnail picture appended to the mark. If 
the ref_^thumbnailjndex field is of a value different from OxFFFF, a. thumbnail picture Is added to its rpark, with the 

^0 thumbnail ptoture being stored in the mark.thumb file. This picture is referenced.using the value of ref„thumbnail Jndex 
in the mark.tliumb file, if the ref.thumbhalljndexfield is of aveilue equal to QxFFFF, athumbnait picture not appended 
to its mairk. 

[0258] MakerPrivateData has already been explained with reference to Fig;22 and hence is not explained here spe- 
cifically. 

'5 [025d] Next, thunrtbnail Jnformation is explained. A thumbnail pteture is stored in a menu.thmb f lie or in a mark.thmb 
. file. These files are of the same Syntax structure and own a sole ThunribnailQ, The menu.thmb ftle stores a picture 
representing respective Platy Lists. The totality of menu thumbnails are stored in the sole menu.thmb file. 
[0260] tHe rnark.thmb file stores a mark thumbnail picture, that is a pknufe representing a mark point. The totality 
of mark thumbnail$ corresponding to the totality of PlayLists and Clips are stored in the sole mark.thmb file. SInce.the 

20 thumbnails are frequently added or deleted, the operation of addition and partial deletion must be executable readily 
and speedily. Forthis reason, Thmbnail() has a block structure. Pk^ture data is divided Into plural portions each of which 
is stored In one tn^bjlock. One pidure data is stored in consecutive tn.blpcks. In the string of tri_bkx:ks, there may 
exist a tn_block not In use. The byte length of a sole thurnbnall picture is variable. 

[0261] Fig78 shows the syntax of menu.thmb and mark.thmb and Fig.79 tlie syntax of Thumbnail In the syntax of 
2S menu.thnt) and mark.thmb shown in Fig.78. By way of explanation of the syntax of Thunrtbnall, shovyn in Fig.79, 
yersion^number is four character letters denoting the version number of this ThumbnailQ. Version^pumber must be 
jencoded to "0045" In accordance with ISO 646. 

[0262] Length is a 32-bit unsigned integer indicating the number of bytes of MakerPrivateData() as frorh directly at 
back of the length field up to the trailing end of ThumbnailQ. Tu.block.start.address is a 32-bit unsigned integer 

30 indicating the leading end byte address of the first tn_block, in temrks of the relative number of bytes as from the leading 
end byte of Thumbnalj() as a unit. The number of relative bytes is counted from 0. Numb^r^of.thumbnails Is a 1 6-blt 
unsigned Integer which gives the number of entries of a thumbnail pteture contained In ThumbnailQ. 
[0263] Tu.block^slze Is a 1 e-blt unsigned integer which gives the size of one tn^block, in terms of 1 024 bytes as a 
unit. If, for example, tn_biock^slze = 1 , It Indicates that the size of one tn_block is 1024 bytes. Number_of_tn_blocks 

35 isa 116-bit unsignedlintegerindtoatingthenumber of entries oftn^block in this Thumbnail. Thumbnailjndex isa16-bit 
unsigned integer indicating the Index number of the thumbnail picture represented by the thumbnail infomiation for 
one for-loop beginning from the thumbnail Jndex field. The value OxFFFF must not be used as Thumbnailjndex. This ^ 
Thumbnaiijridex is referenced by ref Jhumbnailjndex in UlAppinfoVoiumeO, UlApplnfoPlayListQ, PlayListlWarkQ and 
CiipMarkQ. 

4o [0264] ThumbnailjDicture Jonnat is an 8-bit unsigned integer representing the picture format of a thumbnail picture 
. and assurhes a value shown in Rg.80. in the table, DCF and PNG are allowed only in menu.thumk). The mark thumbnail 
must assume the value of "0x00" (I^PEG-2 Video 1 -picture). 

[0265] PIcture.data.sIze is a 32^blt unsigned integer indicating the byte length of a thumbnail picture in temris of 
bytes as a unit. Start_tn_block_number is a 16-bit unsigned integer indicatinjg the tn^block number-of the tn_block 
-^5 where data of the thumbnail picturebegins. The leading end of the thumbnail picture data must coincide with the leading 
end of the tn_block. The tn_block nunnber begins from 0 and is relevant to the value of a variable k in the for-loop of 
.tn_block. . 

[0266] XjDictureJength is a 16-bit unsigned Integer indicating the number of pixels in the horizontal direction of a 
frame of athumbnail pk;ture. Ylpicturejength is a 1 erbit unsigned integer indicating the number of pixels In the vertical 

50 directlofi of a frame of a thurribnail pteture. Tn_block is an area In which to store a thumbnail picture. All tn_block in 
the ThunribnallO are of the same size (fixed length) and are of a size defined by tn^block^^^ 
[0267] Figs.81 A and 81 B schematically show how thumbnail picture data are stored in tn.blpck. if. as shown in Figs. 
81 A and 81 B, the thumbnail picture begins at the leading end of tn_b!ock, and is of a size exceeding 1 tn_btock, |t is 
• stored using the next following tn_block. By so doing, data with a variable length can be managed as fix^ 

^ sothattheedltlngof deletion can be coped with by simpler processing. 

[0268] An AV stream file is now explained. The AV stream file is stored in the "M2TS" directory (Fig.14)-There are 
two types of the AV stream file, namely a Clip A strj&am file and a Bridge-Clip AV istream file. Both AV streams must 
be of the structure oif DVR MPEG-2 transport stream file as hereinafter defined. 
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[0269] First, the DVR MPEG2 transport stream is explained. The structure of the OVR IMPEG-2 transport stream is 
shown in Flg.82. The AV stream file has the structure of a DVR i\1PEG 2 transport stream. The DVR MPEG 2 transport 
stream is made up of an integer number of Aligned units. The size of the aligned unit Is 6144 bytes (2048*3 bytes). 
The Aligned unit begins from the first byte of the source paclcet. The source packet is 192 bytes long. One source 
5 paclcet Is comprised of TP.extra.header and a transport packet. TP.extra.header Is 4 bytes long, with the transport 
packet being 188 bytes long; 

[0270] One Aligned unit is made up of 32 source packets. The last Aligned unit In the DVR MPEG2 transport stream 
is also made up of 32 source packets. Therefore, the DVR MPEG 2 transport stream ends at a boundary of the Aligned 
unit. If the number of the transport packets of the Input transport stream recorded on a disc is not a multiple of 32, a 
10 source packet having a null packet (transport packet of PID = 0x1 FFFF) must be used as the last Aligned unit. The file 
system must not use excess information in. the DVR MPEG 2 transport stream. 

[0271 J Flg.B3 shows a recorder model of the DVR MPEG 2 transport stream. The recorder shown in Flg.83 is a 
conceptual model for prescribing the recording process. The DVR MPEG 2 transport stream obeys this model. 
[0272] The Input timing of the MPEG 2 transport stream is now explained. The input MPEG 2 transport stream is a 
full transport stream or a partial transport stream. The input MPEG 2 transport stream must obey the ISO/IEC1 381 8-1 
or ISO/IEC 13818-9. The nwiber i byte of the MPEG 2 transport stream is input simuftaneously at time t(l).to T-STD 
(transport stream system tariget decoder provided for in SO/I EC 1381 8-1) and to the source packetizer. Rpk Is an in- 
stantaneous maximum value of the iriput rate ^f the transport packet. « . . 
[0273] A 27 MHz PLL 52 generates a frequency of 27 MHz clock. The 27 MHz clock frequency Is locked at a value: 

20 of the program clock reference (PGR) of the MPEG 2 transport stream. An an^ival time clock counter 63 counts the 
pulses of the 27 MHz frequency. Arrival Jime_clock(l) Is a count value of the arrival time clock counter.at time ^1). . 
[0274] A source packetizer 54 appends TP_extra_header to the totality of the transport packets to create a source 
packet. An-lvaljime^stamp Indbates the time when the first byte of the transport pabket reaches both the T-STD and 
the source packetizer, An1val_tlme_stamp{k) is a sampled value of the Arnvaijime.clock(k) as represented by the 

^ following equation: 

an'lvaLtlme_8tamp{k) « amvaLtime_ciock(k)% 230 

30 where k denotes the first byte of the transport packet. 

[0275] If the time separatton between two neighboring transport packets is 230/2 7000000 sec (about 40 sec) or 
longer, the difference of the arrivaLtime.stanrtp of the two transport plackets should be set to 230/2 7000000 sec. The 
recorder Is provided for such case. 

[0276] A smoothing buffer 55 smoothes the bitrate of the Input transport stream. The smoothing buffer must not 
^ overflow. Rmax Is the output bitrate of the source packet from the smoothing buffer when the smoothing buffer Is not 
null. If the smoothing buffer is null, the output bitrate of the smoothing buffer Is 0. 

[0277] Next, the parameters of the recorder model of the DVR MPEG 2 transport stream are explained. The value 
of Rmax is given by TS_recording_rate as defined in Cllplnfo() associated with the AV stream file. This value may be 
calculated from the following equation: 

40 . 

Rmax = TS_reoording_rateM 92/1 88 

where the value of TS„recording_rate Is of a size In bytes/second. : 
45 [0278] If the Input transport stream is an SESF transport stream, Rpk must be equal to TS_recordlng_rate as defined 
in GliplnfoO associated with the AV stream file, if the Input transport stream is not an SESF transport stream, reference 
may be made to values defined e.g., In a descriptor of the MPEG 2 transport stream, such as 
maximum_bltrate_descrlptor or partlal_stream_descriptor for this value. 

[0279] If the input transport stream Is an SESF transport strisam, the smoothing buffer size is 0. If the |nput transport 
50 Stream is not an SESF transport stream, reference may be made to values defined in the descriptor jof the MPEG 2 
transport stream, such as, for example, the values defined In the smoothing„buffer_descrlptor, short.smoothing 
_buffer_descrlptor or in the partial Jransport_stream_descriptor: 

[0280] For the recorder and the player (reproducing apparatus), a sufficient size buffer needs to be provided. The 
default buffer size Is 1536 bytes. 
55 [0281 ] Next, a player model of the DVR MPEG 2 transport stream is explained. Fig.84 shows a player-model of the 
DVR MPEG 2 transport strearri. This Is a conceptual model for prescribing the reproduction process. The DVB.MPEG 
2 transport stream obeys this model. 

[0282] A 27 MHz X-tat 61 generates the frequency of 27 MHz. An error range of the 27MHx frequency must be ±30 
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ppm (2 7000000 ±810 Hz) . The arrival time dock counter 62 is a binary counter for counting the pulses of the frequency 
of 27 MHz. An1vaLtime_clock(i) is a count value of the arrival time clock counter at time t(l). 
[0283] In the smoothing buffer 64, Rmax is the input bitrate of the source packet to the smoothing buffer when the 
' smoothing buffer Is not full. If the smoothing buffer is full, the input bitrate to the smoothing buffer is 0. 
s [0284] . By way of explaining the output timing of the MPEG 2 transport stream, If the arrivaLtime.stamp of the cun^ent 
source packet is equal to 30 bits on the LSB side of arr{vaLt{me_clock(i)» the transport packet of the source packet Is 
removed from the smoothing buffer. Rpk is an instantaneous maximum vaiue of the transport packet rate. The overflow 
of the smoothing buffer is not allowed. 

[0285] The parameters of the player model of the DVR MPEG 2 transport stream arie the same as those of the 

10 recorder model of the DVR MPEG 2 transport stream described above, 

Fig.BS shows the syntax of the source packet. Tran8port_packet() Is an MPEG 2 transport stream provided 
in ISO/IEC 13818-1 . The syntax of TP Extra-header in'the syntax of the source packet shown in Flg.85 Is shown In 
Rg.86. By way of explaining the syntax of the TP_Extra-header, shown in Flg.B6, copyj)enmlssion_indlcator is an 
Integer representing the copying limitation of the payload of the transport packet. The coping limjtatlon may be copy 

IS free, no more copy, copy .once or copying prohibited. Fig.87 shows the relation between the value of 
copy^permissionjndicator and the mode it designates. 

[0287] Copy^pennission Jndlcator is appended to the totality of transport packets. If the Input transport stream Is 
recorded using the lEEEi 394 digital Interface, the vaiue of copyj>emlission Jndicator may be associated with the 
value of EMI (encryption mode Indtoator). If the Input transport stream is recorded without employing the IEEE1394 • 
^ digital Interface, the value of copyjpemiissionjndicator may be associated with.the value of the CCI embedded In the 
transport packet If an analog signal input is self-encoded, the value of copy j^emiission Jndbator may be associated 
with the vaiue of CGMS-A of the analog signal. 

[0288] AnrivaLtime.stamp is an integer having a value as specified by anivaljime^stamp in the following equation: 

25 

anival_time_8tamp(k) anival_tlme_clock(k)%230. 

[0289] By way of defining the ClipAV stream, the CiipAV stream must have a stmcture of the DVR MPEG 2 transport 
stream defined as described above. AmvaLtlme_clock(i) must increase continuously in the Clip AV stream. If there 
30 exlsts a discontinuous point of the system time base (STC base) In the Clip AV stream, an'ival_tlme_clock(i) In the Clip 
AV stream must Increase continuously. 

[0290] The maximum value ot the different of the amvaLtime^clock(i) between the beginning and the end of the Clip 
AV strearn must be 26 hours. This lihittation guarantees that, If there is no discontinuous point In the system time base 
(STC base) In the MPEG 2 transport stream, the PTS (presentation time stamp) of the same value never appears In 
3s the Clip AV stream; The lyiREG 2 system standard provides that the PTS has a wraparound period of 233/90000 sec 
{about 26.5 hours). 

[0291] By way of defining the Bridge-Clip AV stream, the Bridge-Clip AV stream must have a structure of the OVR ; 

MPEG 2 transport stream defined as described above. The Bridge-Clip AV stream must include a discontinuous point 

of one arrival time baserThe transport atrsam^ahead and at back of the discontinuous point of the arrival time base 
40 must obey the encoding limitations and the DVR-STD as later explained. 

[0292] The present embodiment supports the video-audlo seamless connection between Playltems being edited. 
. Seamless connection between Playltems guarantees "continuous data sif>ply" to the player/decoder and "seamless 

decoding processing". The "continuous data supply*' is the capability of guaranteeing data supply to the decoder at a 

bitrate necessary to prevent buffer underflow. In order to enable data to be read' out from. the disc as data real-time- 
45 properties are assured, data is to be stored in terms of a continuous block of a sufficiently large size as a unit. 

[0293] The Seamless decoding processing"* means the capability of a player in displaying audio video data recorded 

on the disc without prcKJucing pause or gap in the playback output of the decoder. 

[0294] The AV stream, referenced by the seamless connected Playltems, is explained. Whether or not the seamless 
display of a previous Playltem and the current Piayltem is guaranteed may be verified from the connection.condition 
so field defined in the cunrent Piayltem. There are two methods for seamless connection of Playltems, that Is a method 
employing Bridge-Clip and a method not employing Bridge-Clip. 

[0295] Flg.d8 shows the relation, between the previous Piayitem and the cun'ent Playltem in case of employing 
Bridge-CI^. In Rg.88, the stream data, read out by the player, is shown shaded. In ng.68. TS1 is rnade up of shaded 
stream data of the Clip1 (Clip AV stream) and shaded stream data previous to RSPN_arrivalJime_discontinuity. 
55 [0296] The shaded stream data of Clip1 of TS1 is stream data from an address of a stream required for decoding 
the presentation unit correspondirig to IN Jtem of the previous Playltem (shown as IN-timel In Fi^.eS) up to the source 
packet referenced ' by PiSPN_exltJrom_prevjous_CIip. The shaded stream data prior to 
RSPN_arrival_tlme_discontlnuity of Bridge-Clip contained-in TS1 is s^tream data as from the first source packet of 
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Bridge-Clip up to the source packet directly previous to the source packet referenced by 
RSPN.arrlvalJlme^discontinuity. 

[0297] - In Fig.86. TS2 Is made up-of shaded stream data of Clip 2 (Clip AV stream) and shaded stream data subse- 
quent to RSPN.anrlvaljIme^discontlnulty of Brkige-Cllp. The shaded stream data as from the 
RSPN^arrlvalJIme^discontlnully of Bridge-Clip contained In TS2 stream data from the source packet referenced by 
RSPN.arrivaLllme^dlscontlnulty to the last source packet of Bridge-Clip. The shaded stream data of Cllp2 of TS2 is 
stream data from the source packet referenced by RSPN_enter_lo_current_Clip to the address of the stream required 
for decoding the presentation unit corresponding to OUTJIme of current Playltem (shown by OUT_tlme2 In Fig.88). 
[0298] Flg.B9 shows the relation between the previous Playltem and the current Playltem In case of not employing 
Bridge-Clip. In this case, the stream data read out by the player Is shown shaded. In Flg.89,T81 Is made up of shaded 
stream data of the Clipl (Clip AV stream). The shaded stream data of Cllp1 of TS1 is data beginning at an address of 
a stream necessary In decoding a presentation unit corresponding to IN_time of the previous Playltem, shown at 
IN Jlme1 in Flg.89 as far as the last eource packet of Cllpl . . 
[0299] (n Rg.89, TS2 Is shaded stream data of Cilp2 (Clip AV stream). 

[0300] The shaded stream data of Clip2 of TS2 Is stream data beginning at a first source packet of Cllp2 as far as 
an address of the stream necessary for decoding the presentation unit corresponding to OLrTJIme of current Piayftem 
(shown at 0UT_time2 in Flg.89). 

[0301] In Rga,88 and 89; TS1 and T2 are continuous streams of the source packet. Next, the stream provisions of 
TS1 and TS2 and the connection conditions therebetween are scrutinized. First, encoding limitations for seamless 
connection are scrutinized. By way of llmitatlona on the encoding structure of a transport stream, the number of pro- 
grams contained In TS1 and TS2 must be 1 . The number of video streams contained In TS1 and TS2 must be 1 . The 
number of audio streams contained in TS and TS2 must be 2 or less. The numbers of the audio streams contained in 
TS1 and TS2 must be equal to each other it Is also possible for elementary streams or private streams other than 
those depteted above to be contained In TS1 and/or TS2. 

[0302] The limitations on the video bitstream are now explained. Fig.90 shows atypical seamless connection Indi- 
cated by a picture display sequence. In order for a video stream to be demonstrated seamlessly In the vtelnity of a 
junctton point, unneeded pictures-displayed at back.of OUT Jlme1 (OUTjIme of Clipl ) and ahead of IN Jlme2 (IN^tlmo 
of Cllp2) must be removed by a process of re-encoding the partial stream of the Clip In the vicinity of the junction point. 
[0303] Fig.91 shows an embodlment.of realizing seamless connection using BrIdgeSequence. The video stream of 
Brldge*Clip previous to RSPN.amvaLtime^discontlnutty is comprised of an encoded video stream up to a picture 
corresponding to OUTjImel of Clipl of Flg.90. This video stream Is connected to the vfdecl stream of prevtous Cllpl 
and is re-encoded to fomi an elementary stream conforming to the MPEG2 standard. 

[0304] The video stream of Bridge-Clip subsequent to RSPN_an1vaLtlme_dl8coritlnulty Is made up of an encoded 
video stream subsequent to a picture corresponding to IN_time2 of Cilp2 of Flg.90. The decoding of this video stream 
can be started correctly for connecting the video stream to the next following Clip2 video stream. Re-encodlng Is made 
such that a sole continuous elementary stream confomning to MPEG 2 standard will be fomned. For creating Bridge-Cllpi 
several pictures in general need to be re-encoded, whilst other pictures can be copied from the original Clip. 
[0305] Fig.92 shows an embodiment of realizing seamless connection withoiit employing BridgeSequence In the 
embodiment shown in Fig.90. The Clipl video stream Is comprised of an encoded video stream as far as the picture 
corresponding to OUTjImel of Fig.90 and is re-encoded eo ae to give an eiennentary stream confonning to the MPEG2 
standard, in similar manner, the video stream of Cllp2 Is made up of encoded bllBtreams subsequent to the picture 
associated with IN_tlme2 of Clip2 of Flg.90. These encoding bltstreams are already re-encoded to give a sole contin- 
uous elementary stream confonning to the MPEG2 standard. 

[0306] By way of explaining encoding llmitatlona of the video stream, the frame rates of the vkieo streams of TS1 
and TS2 must be equal to each other. The video stream of TS1 must be temnlnated at sequence.end^code. The video 
stream of TS2 must comnrjence at Sequence header, GOP Header and with an l-plcture. The video stream of TS2 
must commence at a closed GO R . 

[0307]- The video presentation-units defined In a bitstream (frame or field) must be continuous with a Junction point 
In-between. No gap of the fields or frames are allowed to exist at Junction points. In case of encoding employing 3-2 
pulldown, It may be necessary to rewrite "topjeld^firsf ' and "repeatJIfstJieW" flags. Alternatively, local re-encoding 
may be made to prevent field gaps fmm being produced. 

[0308] By way of explaining encoding limitations on the audio bitstream, the audio sampling frequency of TS1 and 
that of TS2 must be equal to each other. The audio encoding method of .TSI and that of TS2 (for example, MPEG1 
layer 2. AC-3, SESF LPCM and AAC) must be equal to each other. 

[0309] By way of explaining encoding limitations on MPEG-2 transport stream, the last audio frame of the audio 
stream of TS1 must contain audio samples having a display timing equal to the display end time of the last display 
picture of TS1 . The first audio frame of the audio stream of TS2 must contain an audio sample having a display timing 
equal to the display start timing of the first display picture of TS2. 
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[031 0] At a Junction point, no gap may be allowed to exist in a sequence of the audio presentation units. As stiown 
in Rg.93, there may be an overlap defined by the length of the audio presentatton unit less than two audio frame 
domains. The first packet transmitting an elementary stream of TS2 must be a video packet. The transport stream at 
the junctksn point must obey the DVR-STO whk:h will be explained subsequently 

[0311] By way of explaining Kmltattons on the Clip and Bridge-Clip, no discontinuities In the anival time base are 
allowed to exist In TS1 or In TS2. 

[0312] The following limitations are applied only to the case of employing the Bridge-Clip. The Bridge-Clip AV stream 
has a sole discontinuous point in the arrival time base only at a junction point of the last source packet of TS 1 and the 
first source packet of tS2. The SPN^arrlval Jlme_discontlnulty defined in CliplnfoQ represents an address of the dis- 
continuous point, which must represent the address referencing the first source packet of TS2, 
[0313] The source packet referenced by RSPN_exit_from_prevlous_Cllp defined in BridgeSequencelnfoQ may be 
any source packet in CIqdI . It Is unnecessary for this source packet to be a boundary of the Aligned unit. The source 
packet referenced by RSPN_enter_to_current_Clip defined in BridgeSequenceinfoQ may be any source packet in 
Clip2. It is unnecessary for this source packet to be a boundary of the Aligned unit. 

[0314] By way of explaining limitations on Playltem, the OUT_time of the previous Play Item (OUT_tihie 1 shown In 
Fig.iB9) must represent the display end time of the last video presentation unit df TS1 . The INJIme of the cun^nt 
PlayTime (IN Jime2 shown in Flg.88 and 89) must represent the display start time of the first presentation unit of TS2. 
[0315] By way of explaining the limitations on the data allocation in case of employing Bridge-Clip by referring to Fig. 
94, the seamless connection must be made to guarantee continuous data supply by the file system. This must be 
realized by arranging the Bridge-Clip AV stream, connecting to Clipl (Clip AV stream file) and CUp2 (Clip AV stream 
file), such as to satisfy data aiiocation prescriptions. 

[0316] RSPN_exlt_fromj3revious_Clip must be selected so that the stream portion of Clipl (Clip AV stream file) 
previous to RSPN^exit Jrom_previous_Clip will be an^nged in a continuous area not less than half fragment. The data 
length of the Bridge-Clip AV stream must be selected so that the data will be arranged in the continuous area not less 
than half fragment. RSPN^enter Jo_:Cun^nt.Clip must be selected so that the stream portion of Clip2 (Clip AV stream 
file) subsequent to RSPN_enter_to_cun'ent_Clrp will be arranged in a continuous area not less than half fragment. 
[0317] By way of explaining data aiiocation limitations in case of seamless connection not emptoying Bridge-Clip, 
by referring to Rg.95, the seamless connection must be made so as to guarantee continuous data supply by the file 
system. This must be realized by arranging the last portion of the Clipl (Clip AV stream file) and the first portion of the 
Cllp2 (Clip AV stream file) so that the provisions on data allocation will be met. 

[031 8] The last stream portion of Clipl (Clip AV stream file) must be arranged In a continuous area not less than one 
half fragment The first stream portion of Clip2 (Clip AV stream file) must be anmnged In a continuous area not less 
than one half fragment. 

[0319] In a case where digital AV signals each having a predetemriined bit rate are fragmented and recorded on a 
disc, to assure that the recorded digital AV signals can be read out from the recording medium 1 00 in the predetermined 
bit rate, the size of one continuous recording area must satisfy the following condition: 

S*8 / (S*8/Rud + Ts) >= Rmax 

where 

S: minimum size of one continuous recording area [Byte] 

Ts: access time of full stroke from one recording area to next recording area [second] 
Rud: bit rate for reading out from recording medium [bit/second] 
Rmax: bit rate of AV stream [bit/second]. 

[0320] That isj the data must be arranged so that S byte or more data in the AV stream may be recorded continuously 
on the disc. 

[0321] The data must be arranged-so that.the size of the half fragment may be S byte or more. 
[0322] Next, DVR-SJD is explained. This DVR-STD is a conceptual model for modeling the decoding processing in 
the generation and verification of the DVR MPEG 2 transport stream. The DVR-STD is also a conceptual model for 
modeling the decoding processing in the generation and verification of the AV stream referenced by two Playltems 
seamlessly connected to each other as described above. 

[0323] Fig.96 shows a DVR-STD model. The model shown In Fig.96 includes, as a constituent element, a DVR 
MPEG 2 transport stream player model. The notation of n, Tbn, Mbn, Ebn, Tbsys, Bsys, Rxn, Rbxn, Rxsys, Dn, Days, 
On and P9(k) is the same as that defined In T-STD of ISO/I EC 1 381 8-1 , wherein n Is an index number of an elementary 
stream and TBn Is a transport buffer of the elementary stream n. 
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[0324) MBn is a multiplexing buffer of the elementary stream n and exists only for the video stream. EBn is an 
elementary stream buffer of the elementary stream n and is present only for the video stream. TBsys is a main buffer 
In a system target decoder for the system Information for a program being decoded. Rxn Is a transmission rate with 
which data is removed from TBn. Rbxn Is a transmission rate with which the PES packet payioad is removed from MBn 

9 and is present only for a Video Stream. 

[0325] Rxsys Is a transmission rate with. which data Is removed from TBsys. Dn is a decoder of the elementary stream 
n. Dsys is a decoder pertinent to the system infomnation of a program being decoded. On Is a re-ordering buffer of the 
video stream n. Pn{k) is a number k presentation unit of the elementary stream. 

[0326] The decoding process for DVR-STD is explained. During the time a sole DVR MPEG 2 transport stream is 

10 being reproduced, the timing of Inputting the transport packet to TB1 , TBn orTBsys Is determined by arrivaLtime_stamp 
of the source paci<Qt. Tho prescriptions for the buffering operation of TB1 , MB1 , EB1 , TBn Bn, TBsys and Bsys aro the 
same as those of the T-STD provided for in ISO/iEC 13818-1 . while the prescriptions for the deciding and display 
operations are also the same as the T-STD provided for in ISO/IEC 13818-1 . 

[0327] The decoding process dunng the time the seamlessly connected PiayUsts are being reproduced Is now ex- 
15 plained. Here» the reproduction of two AV streams referenced by the seamlessly connected Piayltems is explained, in 
the following explanation, the reproduction of TS1 and tS2. shown for example in Flg.88, is explained. TS1 and TS2 
are a previous stream and a current stream, respectively. 

[0326] Fig. 97 shows a timing chart for inputting, decoding and display of transport pacitets when transfening from 
a given AV stream (TS1 ) to the next AV stream seamlessly connected thereto (TS2). During transfer from a preset AV 

20 stream (TS1 ) to the next AV stream seamlessly connected thereto (TS2), the time axis of the arrival time base of TS2 
is not the same as the time axis of the arrival time base of TS1 (indicated by ATC1 in Fig.97). 
[0329] Moreover, the time axis of the system time base of TS2 (Indicated by ATC1 in Flg.97) is not the same as the 
time axis of the system time base of TS1 (indicated by STC1 in Fig.d7). The video display is required to be continuous 
seamlessly, however, there may be overlap in the display tine of the presentation units. 

25 [0330] The input timing to DVR-STD is explained. During the time until time T1 , that Is until the Inputting of the last 
video paclcet to the TBI of DVR-STD, the input timing to the buffers of TBI , TBn or TBsys of DVR-STD Is detennlned 
by anivai_time_stamp of the arrival time base of TS1 . 

[0331] The remaining pacl<ets of TS1 must be input to buffers of TBn or to TBsys of DVR-STD at a bitrate of 
TS_recordlng_rate (TS1 ). The TS_recordlng_rate (TS1 ) Is the value of TS^recordlng^rate defined in CllpinfoO con^e- 
39 sponding to Clip1 . The time the last byte of TS1 is input to the buffer is the time T2. So, during the time between time 
T1 and time T2, amval_time__stamp of the source pacicet is discounted. 

[0332] if N1 is the number of bytes of the transport pacicet of TS1 next following the last video packet of TS1 , the 
time DTI from Wwb T1 until time T2 Is the time necessary for N1 bytes to be Input completely at a bitrate of 
TS.recordlng^rate (TS1 ), and Is calculated In accordance with the following equation: 

35 

DT1 = T2 - T1 = NI/TS.recording^rate. 

[0333] During the time from time T1 until time T2 (TBI ), both the values of RXn and RXsys are changed to the value 
^ of TS-rBcording_rate (TS1 ). Except this rule, the buffering operation is the samo as that of T-STD. 

[0334] At time T2, the arrival time clock counter is reset to the value of amvai Jlme.stamp of the first source packet 
of TS2. The input timing to the buffer of TB1 . TBn or TBsys of DVR-STD is detenmined by arrivaljime^stamp of the 
source packet of TB2. Both RXn and RXsys are changed to values defined in T-STD. 

[0335] By way of explaining additional audio buffering and system data buffering, the audio decoder and the system 
decoder need to have an additional buffering amount (data amount equivalent to one second) In addition to the buffer 
amount defined In T-STD In order to allow input data of a domain from time T1 to time T2. 
[0336] By way of explaining the video presentation timing, the display on the video presentation unit must be con- 
tinuous, that is devoid of gaps, through junction point. It is noted that STG1 is the time axis of the system time base of 
TS1 (indrcated as STC1 in ng.9). while STC2 is the time axis of the system time base of TS2 (shown at STC2 in Fig. 
so 97; correctly, STC2 begins ^t time the first PGR of TS2 has been input to the T-STD), 

[0337] The offset between STC1 and STC2 is determined as follows: the PTStend is the PTS on STC1 corresponding 
to the last video presentation unit of TS2. PTS2start is PTS on STC2 corresponding to the first video presentation unit 
of TS2 and Tpp is the display time period of the last video presentation unit of TS1 . the offset STC.delta between two 
system time bases is calculated in accordance with the following equation: 

55 

STC.deila « PTS1 end + Tpp - PTS28tart. 
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[0338] By way of explanation of the audio presentation timing, there may be overiap In the display timing of the audio 
presentation unit, with the overlap being less than 0 to 2 audio frames (see "audio overiap" ishown in Flg.97). The 
indication* as to which of audio samples is to be selected and re*synchronizatlon of the display of the audio presentation 
unit to the corrected time base at back of the junction pojnt are set on the player 
5 P339] By way of explaining the system time dock of DVR-STD,.the laist audio presentation unit of TS1 Id displayed 
at time T5. The system time clock may be overlapped between time T2 and time T5\ [Xiring this time domain, the 
DVR-STD switches the system time clocks between the value of the old time base (STC1) and the value of the new 
time base (STC2). The value of STC2 may be calculated In accordance with. the following equation: 

. STC2=STC1-STC_delta. 

[0340] Thb buffering continuity is explained. STCIIvtdeo.end Is the value of STC on the system time base STC2 
when the first byte of the first video packet reaches TBI of DVR-STD. STC22video_start is the value of STC on the* 
IS system time base STC2 when the first byte of the first video packet reaches TBI of DVR-STD. STC21 vldeo^end is 
- the value of STC11 vldeo^iand calculated as the value on STC2 of the system time base STC2. STC21 vldeo_end Is 
calculated, in accordance with the following equation: * . 

^ STG2lvldeo_end-STC1lvldeo_end-STC_delta. 

[0341] In order to obey DVR-STD, the following two conditions must be met First, the arrival timing of the first video 
packet of TS2 at TB1 must satisfy the following inequality: 

25 

STC22vl.deo_start > STC21 video_end.-i- ATI . 

[0342] If it is necessary to re-encode and/or multiplex the partial stream of Clip1 andfor Clip2; in such a manner that 
the abovef Inequality will be satisfied, this re-encoding or multiplexing is perfomied as appropriate. 
30 [0343] Second, the Inputting of the video packet from TS1 followed by the inputting of the video packet from TS2 on' 
the time axis of the system time base, mapped from STCl. and STC2 on the same time axis, must not overflow or 
underflow the video buffer. 

[0344] if the above syntax, data structure and the rules are used as basis, the contents of data recorded on the 
recording medium or the reproduction infonnation can t>e managed properly to enable the user to confirm the contents 
35 of data recorded on the recording medium at the time of reproduction or to reproduce desired data extremely readily. 
[0345] In the above-described embodiment, the MPEG 2 transport stream is taken as an example of the multiplexed 
stream. This, however, is merely exemplary, such that the MPEG 2 program strearn DBS or the transport stream used 
in the DirecTV Service (trade mark) of USA may also be used as the multiplexed stream. 

[0346] Fig.98 shows a modlficatk>n of BridgeSequericelnfo(). The difference from the BridgeSequencelnfoQ of Fig. 

40 38 is that it contains only Bridge_Clip_lnfomnatlon_file_hame. 

[0347] Rg.99 illustrates Bridge^Clip when two Playitems are seamlessly connected in case of using the syntax of 
BridgeSequencelnfoO of Fig.98. RSPN_oxit Jrom_previous_Clip is the source packet number of the source packet on 
. ^e Clip AV stream referenced by the previous Playltem. Next to this source packet is connected the first sourcapacket 
of the Bridge_Cllp AV stream file. 

45 [0348] RSPN^enterjo^cun-ent.Clip is the number of the source packet on the Clip AV stream referenced by the 
current Playltem. Ahead of this source packet is connected the last source packet of the Brtdge-Cltp AV stream file 
referenced by the current Playltem. In the Bridge-Clip AV stream , shown in Fig.99, SPN_ATC_start indicates the source 
packet number of the source packet in the Bridge*Cllp AV stream file at which commences the time axis of new arrival ' 
time base, 

so [0349] The Bridge-Clip AV stream fUe has a sole arrival time base discontinuous point. The second SPN.ATC.start 
In the drawings has the same meaning as that of the RSPN_arrivalJlme_discontlnuIty In Fig;37. 
[0350] If the syntax of BridgeSequencelnfoO of Fig.98 is used. RSPN_exitJromj:)reyiou8_Cllp and 
RSPN.enterJo_cun^ent_Cllp are stored \n the Clip Information, file con-esponding to the Bridge-Clip AV stream file, 
SPN_ATC_start is also stored In the Clip Infomiatlon file. 

ss [0351] Fig.i 00 shows the syntax of the Clip Infonnation file when the BridgeSequencelnfo is of the syntax of Fig.98. 
Sequencelnfo_start_address Indicates the leading address of SequencelnfoQ, in tenms of the number of relative bytes 
from the leading byte of the Clip infonrtation file as a unit. The number of relative bytes is counted from 0. 
. [0352] Flg.101 shows the syntax of Cliplnfo() of theCIlp Intdnnatlonflleof f=^ig.100. CIIp„stream_type Indicates wheth- 
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er the AV stream file of the Clip Is the Clip AV stream file or the Bridge-Clip AV stream file. If the Cllp.8tream_type 
Indicates the Bridge-Cllp AV stream file, the next syntax field follows. 

[0353] Previous.Cllp^lnfomriatlonJIIe.name indicates the Clip Infonnatlon file name connected ahead of the 
Bridge-Clip AV stream file, RSPN^exltJrom4)revlous_Cllp is the source packet number of the source packet on the 
Clip AV stream file Indicated by prevlous.Cllp.lntonnatlon Jlle^name. Next to this source packet Is connected the first 
source packet of the Bridge-Clip AV stream file. This source packet number Is counted as from the first source packet 
of the Clip AV stream file, with 0 as an Initial value. 

[0354] Cun'ent_Cllp_lnfomiation Jile_name Indicates the Clip Infomiation file name of the Clip connected at back of 
the Bridge-Clip AV stream file. RSPN.enter.to.cun'ent^CHp is the-source packet number of the source packet on the 
Clip AV stream file Indtoated by the current.ClipJnfonnation^file^name. Ahead of this source packet ts connected the 
last source packet of the Bridgo-CIlp AV stream file. This source packet number Is the is counted as from the first 
source packet of the Clip with the AV stream file with 0 as an Initial value. 

[0365] Fig.102 indk»tes the syntax of the. Sequencelnfo() of the Clip Infonmtlon file of FIg.lOO. . 
Num_of_ATC_sequence Indicates the numberof the ATC^sequence in the AV stream file. ATC^sequer^ce Is asource 
packet sequence not containing discontinuous points of the arrival time base, tn the case of Bridge-Clip, this value is 2. 
[0356] SPN.ATC_start[atc.ld] indicates an address at which commences the anival time base Indicated by atc^ld 
on the AV stream file. SPN_ATC_start[atcJd] Is of a size based on the source packet number as unit and is counted 
as from the first source packet of the AV stream file with 0 as an initial value. 

[0357] Figs. 1 03A and 1 038 illustrate database change In case stream data of the Clip AV stream file referenced by 
Bridge-Sequence Is partially erased. It Is assumed that, as Indicated by "Before Editing" in Flg.103A, Cllpl and Cllp2 
are Interconnected by Bridge-Clip, with RSPN^exltJromjjrevlous^Cllp = X and.RSPN_enterjo_cun'ent_Cllp = Y 
[0358] It is assumed that a stream data portion of ZV source packets of Cllpl , shown shaded, and a stream data 
portion of Z1 source packets of Cllp2, likewise shown shaded, are to be erased. As a result, 
RSPN.exitJromjarevlous^Clip becomes equal to X- Z1 and RSPN_enterJo_cument_Cllp becomes equal to Y-Z2, 
by way of value changing, as Indicated by "After Editing" In Ffg.1 03B. 

[0350] By changing the syntax of the database pertinent to BridgeSequence as shown in Figs.OB and 1 01 . the infor- 
mation pertinent to the source packet number Indteating a data address in the AV stream -(a fleW commencing from 
RSPN In the database syntax) Is depleted from the layer of the PlayList, such that the totality of the Infomiatton on the 
source packet number Is stated In the Clip layer. 

[0360] In this case, If it Is necessary to change the value of the data address in the AV stream; as when data of the 
AV stream file has been partially erased, it Is only sufficient If measly the Clip Information file Is supen^sed as data, 
thus advantageously facilitating database management. 

[0361] Flg.l 04 is a flowchart illustrating the preparation of the RealPlayLlst. Reference Is had to the block diagram 
of Fig. 1 showing the recording and/or reproducing apparatus 1 . At step SI 0, a controller 23 records a Clip AV stream. 
At step S11 , the controller 23 fomris PlayUstO made up of Playltems covering.the totality of the possible playback range 
of the above Clip. If there Is STC discontinuous point in the Clip, and PlayLlst() is made up of two or more Playltems, 
the connectlon^condltlon between the Playltems is also detemiined. 

[0362] At step S12, the controller 23 forms UIApplnfoPlayList{). At step S 13, the controller 23 fomis PlayListl^ark. 
At step 1 4, the controller 23 forms Makers PrivateData. At step SIS, the controller 23 records a Real PlayUst file. In 
this manner, one Real PlayUst file is created each time a Clip AV stream file Is newly recorded. 
[0363] Fig. 106 Is a flowchart for illustrating the fontiulation of a Virtual PlayList having a bridge sequence. At step 
S20, reproduction of one Real PlayList recorded on the disc Is specified through a user Interface. From the reproduction 
range of the Real PlayList. the reproduction domain specified by IN and OUT points is specif ied through user interface. 
[0364] At step S21 . the controller 23 verifies whether or not the operation of specifying the reproduction range by 
the user has been finished In Its entirety. If It is verified that the specifying operation has been finished, the controller- 
23 proceeds to step S22 and. If othenwise, the controller 23 reverts to step S20 to rep^t the subsequent processing: 
[0365] At step S22, the user detemilnes the connection condition between two continuously reproduced Playltems 
(connectten^condltlon), through user Interface, or the controller 23 detemilnes the connection condition. At 8tep-S23, 
the controller 23 .fomfi8 a bridge sequence for the seamlessly connected Playltems. At step 854, tghe controller 23 
fomrs and records the Virtual PlayList file. 

[0366] Fig.106 is a flowchart for illustrating the detailed processing at step 823. At step S31 , the controller 23 re- 
encodes and re-multlplexes an AV stream on the OUT point side of the Playltem displayed on the temporally forward 
side. At step S32, the controller 23. re-encodes and re-multlplexes the AV stream on the IN point side of the Playltem 
represented next to the Playltem. 

10367] At step S33, the controller-23 detennines the value of the RSPN^exIt Jrom j)revlous„Clfp such as to satisfy 
the data allocation condition for continuous data supply. That Is, RSPN_exltJrom_prevlous_Cllp must be selected so 
that the stream portion of the Clip AV stream file previous to RSPN.exlLfrom_previous,Cllp will be recorded In a 
continuous area not less than the aforementioned half fragment on the recording nrwdium (see Flgs.91 and 94). 
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[0368] At step S34, the controller 23 determines the value of RSPN.enter^^to.current^Clip such as to satisfy the 
data alloGatlon condition for continuous data suppfy. That Is; RSPN.enter_to_current.Clip must be selected so that 
the stream portion of the AV stream file subsequent to RSPN_enter.to_current_Cllp will be arrayed In a continuous 
area not less than the aforementioned one fragment on the recording medium (see Rgs.91 and 94). 
s [0369] At step S35, the controller 23 fbmis the.Bridge-CI|p AV stream file such as to satisfy the data allocation con* 
ditlon for continuous data supply. That Is, if the volume of data prepared in the processing of steps S31 and S32 Is less 
than the size of the aforementioned one half fragment, data is copied from the original Clip to prepare Bridge-Clip (see 
Rgs.91 and 94). 

[0370] Although the processing operations of steps 833 to S35 is explained chronologically, these processing oper- 
^0 ations may also be carried out non-sequentially or simultaneously since these processing operations are relevant 
reciprocally. 

[0371] At step S36, the controller 23 fomis a bridge sequence database. At step S37, the controller 23 records a 
Bridge-Clip AV stream file and Its Clip Infonnatjon file. In this manner, one or more Piayltem is selected by the user 
froni the reproduction range of Real PlayLlst recorded on thedlscAbrldge sequence for enabtlngseamless connection 
15 . of two Playltems is fomied and a set of one or more Playltems, grouped tojgether, Is recorded as one Virtual PlayUst. 
[0372] Fig.1 07 Is a flowchart for illustrating the reproduction of PlayLlst. At step 841 , the controller 23 acquires Info, 
dvr, a Clip infonnation file, a PlayLlst fits and the thumbnail infomiation to prepare a GUI picture a list of PlayLlsts 
reporded on the disc to display the so formed picture on the GUI through user interface. 

[0373] At step S42, the.cohtroller 23 presents the Information aiustratihg the PlayLlst on the GUI picturie based on 
20 UlApplnfpPlayListO of each PlayLlst. At step S43, the user instructs reproduction of one PlayLlst from the GUI picture 

through a user^interface. At step S44, the controller 23 acquires, from the PTS of IN.tlme and STC-sequecne-ld of the 

current Piayltehi, a source packet having an entry point temporally previous and closest to IN.time. 

[0374] At step S45, the controller 23 reads out data of the AV stream, from the source packet number haying the 

ak>ovie entry point to send the so read out data to decoder. If /at step S46, there is any Piayltem temporally previous 
25 to the current Piayltem, the controller-23.perfonti8 the processing of Interconnecting the prc^vlous Piayltem and the 

current Piayltem in accordance with connectlon^conditior). If the Playltems are interconnected seamlessly, the AV 

stream is decoded based on the DVR-STD discodlng method. - 

[0375] At step S47, the controller 23 commands the AV decoder 27 to start the display as from the picture of the 

PTS of IN.time. At step S48, the controller 23 conrimands the AV decoder 27 to continue decoding the AV stream. At 
30 step S49, the controller 23 verifies whether or not the picture cun-entty displayed is the pic^re of PTS of OUTJme. If 

it Is verified that the pteture culrently displayed Is not the picture of PTS of OUT_tlme, the controller 23 proceeds to 

step S5d to display the picture, after which the controller 23 reverts to step S4B to repeat the subsequent processirig. 

[0376]. If It Is verified at step S49 that the picture currently displayed Is the picture of PTS of OUTjIme, the controller. 

23 proceeds to step 851 where the controller. 23 verifies whether or not the current Piayltem Is the last one In the 
35 PlayLlst. If it is verified that the current Piayltem is not the last one, the controller 23 reverts to step S44 to repeat the 

subsequent processing, if it is verified that ^e current Piayltem is the last one, reproduction of the PlayLlst Is finished. 

[0377] In this manner, the one PlayLlst file, specified to be reproduced by tlie user, is reproduced. 

[0378] Based on the above-described Syntax, data structure and rule, as described above, the contents of data 

recorded on the recording medium, the playback Information and so forth can be properly managed to enabiethe user 
^ to confinin the contents of data.recorded on the recording medium properly to reproduce the desired data extremely 

readily. ' ' . 

(03791/ al:)ove-described sequence of operations may be executed not only by hardware but also by software. If 
the sequence of operations is to be executed by software, it is Installed from a recording medium to a computer in the 
dedicated hardware of which Is Installed the program fomilng the software or to e.g., a general-purpose personal 

45 computer capable of executing various functions based on a variety of programs installed therein. 

[0380] Rjg.i 08 shows an illustrative Inner structure of a general-purpose computer. A CPU (central processing unit) 
201 of the personal computer executes a variety of processing operations in accordance with a program stored in a 
ROM (read-only memory) 202, In a RAM (random-access memory) 203, there are suitably stored data or programs 
necessary for tiie CPU 201 to execute various processing operations. To an input/output interface 205 Is connected 

50 an Input unit 206 fomied by a keyboard, a mouse and so forth to output signals Input to the input unit.206 to the CPU . 
201 . To thQ Input/output Interface 205, there is also connected an output unit 207 made up of a display, a loudspeaker 
andsoforthj 

. . [0381] To the Input/output Interface 2Q5, there are also connected a recording unit 208 made up e.g., of a hard disc 
and a communication unit 209 adapted for exchanging data with outer equipment over a networic, such as Internet. A 
S5 drive 210 is used for reading out or writing data on or from a recording medium, such as a magnetic disc 221 ,-an optical 
disc 222, a magneto-optical disc 223 or a semiconductor memory 2i24. 

[0382] The recording medium is constituted not only by a package medium distributed for furnishing the program to 
the user, in addition to a computer, such as a magnetic disc 221 carrying the program thereon, inclusive of a floppy 
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disc, an optical disc 222, Inclusive of a CD-ROM (Compact Disc-Read-Only memory) or a DVD (Digital Versatile Disc), 
a magneto-optical disc 223, Incluslvd of a Mlnl>Dlsc, or a semiconductor memory 224, but also by a hard disc. Inclusive 
of a ROM 202 carrying a program and a memory 208, furnished to the user as It Is built-in In a computer, as shown In 
Flg.108. 

[0383] In the present specification, the steps of the program furnished by the medium Include hot only the chrono- 
togicai processing in accordance with the sequence indicated, but also the processing performed not chronologically 
but in parallel or separately. 

[0384] Additionally, in the specification, the system means an entire apparatus comprised of plural component de- 
vices. 

industrial Applicability 

[0386] In the information processing method and apparatus, and the program, according to the present Invention, if 
the It is commanded to perform reproduction continuously from the first AV stream to the second AV stream, there Is^ 
generated a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and which Is reproduced when reproduction Is switched from the first AV stream to the second AV stream, while 
there is generated, as the information pertinent to the third AV stream, the address infomiation made up of the Infor- 
mation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first 
AV stream to the third AV stream, and of the Infomiation on the address of a source pacl<et of the second AV stream 
at a timing of switching of reproduction from the third AV stream to the second AV stream. So, reproduction may be 
achieved such as to maintain continuity in separately recorded AV streams. 

[0386] In the infonnatlon processing method and apparatus, and the program, according to the present Invention, a 
first AV stream, a second AV stream or a third AV stream is read out from a recording medium, the address information 
made up of the Information on an address of a sourcepacket of the first AV stream at a timing of switching of reproduction 
from the first AV stream to the third AV stream, and the information on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, Is read out from 
the recording medium as the information pertinent to the third AV stream, and reproduction Is switched from the fireft 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based on the read-out information pertinent to the third AV stream. So, reproduction may be achieved such as to 
maintain continuity In separately recorded AV streams. 


Claims 

1. An information processing apparatus comprising: ' 

generating means for generating, In case continuous reproductton from a first AV stream to asecond AV stream 
is commanded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of 
said second AV stream, said third AV stream being reproduced when reproduction is switched from said first 
AV stream to said second AV stream, arid the address infonnatlon, as the information pertinent to said third 
AV stream, said address Infonnatlon being made up of the rnfdmnatlon on an address of a source packet of 
said first AV stream at a timing of switching of reproduction from said first AV stream to said third AV stream, 
and of the infomiation on the address of a source packet of said second AV stream at a timing of switching of 
reproduction from said third AV stream to said second AV stream; and - 

recording means for recording said third AV stream and said address infonnatlon, as generated by said gen- 
erating means. 

2. The infonnatlon processing apparatus according to claim 1 wherein an arHval time stamp of the source packet of 
said first AV stream included in said address infomiation generated by said generating means, and an anival time, 
stamp of a source packet located at a leading end of said third AV stream, are continuous to each other, and 
wherein an arrival time stamp of the source packet of said second AV stream included in said address infomiation 
generated by said generating means and ah arrh^ai time stamp of a source packet located at a trailing end of said 
third AV stream are continuous to each other. 

3. The infonnath)n processing apparatus according to claim 2 wherein a sole discontinuous point exists In the anival 
time stamp of the source packet in sakl.third AV stream. 

4. The infomrtetlon processing apparatus according to claim 2 wherein said address Is detennlned so that a data 
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portion of the AV stream previous to a source pacl^et specified by tlie Information on the address of the source 
paclcet of said first AV streann contained in said address information generated by said generating means will be 
located in a continuous area of not less than a preset size on a recording medium. 

5 5. The Information processing apparatus according to claint 2 wherein said address is determined so that a data 
portion of the AV stream subsequent to a source packet specified by the information on the address of the source 
packet of said second AV stream contained in said address Infomriatlon generated by said generating means will 
be located in a continuous area of not less than a preset size on a recording medium. 

^0 6. The Information processing apparatus according to.claim 2 wherein said third AV stream is generated so that said 
third AV stream will be located In a continuous area of not less than a preset size on said recording medium. 

7. An Infomnatton generating method comprising; 

a step of generatingp In case continuous reproduction from a first AV stream to a second AV stream is com* 
manded, a third AV stream made up of a.preset portion of said first AV stream and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction Is switched from said first AV 
stream to said second AV stream, and 

a step iof generating the address infonmatlon. as the Infomiation pertinent to said third AV stream, sakJ address 
information being made up of the infomiation on an address of a source packet of said first AV stream at a 
timing of switching of reproduction from said first AV streiam to said third AV stream^ and of the information on 
the address of a source packet of said second AV stream at a timing of switching df reproductton from sdid 
third AV stream to said second AV stream. 

^ 8. A recording medium having recorded thereon a computer-readable program,-saki program comprising: 

a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 
second Ay stream, said third AV stream being reproduced when reproduction is svwtched from said first AV* 
30 stream to said second AV stream, and 

a step of generating the address Infonnation, asthe infomiation pertinent to said third AV stream, said address 
. information being made up of the infomiation on an address of a source packet of said first AV stream at a 
timing of switching of reproduction from said first AV stream to said third AV stream, and of the Infonnation on 
. the address of a source packet of said second AV stream at a timing of switching of reproduction from sakJ 
^. third AV stream to said second AV stream. 

9. A program for having a computer execute a program, said program comprising: 

a step of generating, In case continuous reproduction from a first AV stream to a second AV stream is com- 
^ manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 

second AV stream, said third AV stream being reproduced when reproduction is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address Information, as the information pertinent to said third AV stream, said address 
infomiation being made up of the infomi^tlon-on~an address of a source packet of said first AV stream at a 
^5 timing of switching of reproduction from said first AV stream to said third AV stream, and of the Information on 

the address of a source packet of said second AV stream at a timing of switching of reproduction from said 
third AV stream to said second AV stream. 

. 10; An infomiation processing apparatus comprising: 

50 

first readout means for reading out a first AV stream, a second AV stream or a third AV stream from a recording 
medium; 

second readout means for reading out, as the infomiation pertinent to said third AV stream, the Infomnatton 
on an address of a source packet of said first AV stream at a timing of switching.of reproduction from said first 
ss AV stream to said third AV stream, and of the information on the address of a source packet of said second 

. AV stream at a timing of switching of reproductlon from said third AV stream to said second AV stream; and 
reproducing means for perfomiing reproduction as reproduction is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream. 
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based on the information pertinent to said third AV stream read out by said second readout means. 

11. An Infomnatlon processing method comprising: 

a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium; 

a second readout oontrofiing step of reading out, as the Infomiation pertinent to said third AV stream, the 
infomnatlon on an address of a source packet of said first AV stream at a timing of switching of reproduction 
from said first AV stream to said third AV stream, and of the Information on the address of a source packet of 
said second AV stream at a tiniing of switching of reproduction from said third AV stream to said second AV 

stream; and 

a reproducing stop of performing reproduction as reproduction is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the information pertinent to said third AV stream read out by said second readout means. 

12. A recording medium having recorded thereon a computer-readable program, said program comprising: 

a first readout controiiing step of reading out a fifst AV stream, a second AV stream or a third AV stream from 
a recording medium; 

a second readout controiiing step of reading out, as the information pertinent to said third AV stream, the 
infonmation on an address of a source packet of said first AV stream at a timing of switching of reproduction 
from said first AV stream to said third AV stream, and of the information on the address of a source packet of 
said second AV stream at a timing of switching of reproduction from said4hird AV stream to said second AV 
stream; and 

a reproducing step of perfomning reproduction as reproduction lis switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to satd second AV stream, 
based on the infomiation pertinent to said third AV stream read out by said second readout means. 

13. A program for having a computer execute a program, said program comprising: 

a first readout controiiing step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium; 

a second readout controlUng step of reading out, as the Information pertinent to eald third AV stream, the 
infomiation on an address of a source packet of said first AV stream at a timing of switching of reproduction 
from said first AV stream to said third AV stream, and of the Information on the address of a source packet of 
said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

a reproducing step of perfomilng reproduction as reproduction Is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the information pertinent to said third AV stream read out by said second readout means. 

14. A recording medium having recorded thereon the address Infomiation comprising. In case continuous reproduction 
from a first AV stream to a second AV stream is commanded, a third AV stream made up of a preset portion of 
said first AV stream and a preset portion of said second AV stream, said third AV stream being reproduced when 
reproduction is switched from said first AV stream to said second AV stream, and the address Infomiation, as the 
information pertinent to said third AV stream, said address Infomnatlon being made up of the infomiation on an 
address of a source packet of said first AV stream at a timing of switching of reproduction from said first AV stream 
to said third AV stream, and of the Information on the address of a source packet of said second AV stream at a 
timing of switching of reproduction from said third AV stream to said second AV streanni. 
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